-- Logs begin at Tue 2022-01-25 02:44:18 UTC, end at Tue 2022-01-25 04:01:20 UTC. -- Jan 25 03:26:36.033940 dv-cinder-819011-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 25 03:26:36.042604 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 25 03:26:36 2022] *** Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: nodename: dv-cinder-819011-2-iscsi Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: machine: x86_64 Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: clock source: unix Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: pcre jit disabled Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: detected number of CPU cores: 4 Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: current working directory: / Jan 25 03:26:36.044587 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: detected binary path: /usr/bin/uwsgi-core Jan 25 03:26:36.045222 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: your processes number limit is 47680 Jan 25 03:26:36.045222 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: your memory page size is 4096 bytes Jan 25 03:26:36.045222 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: detected max file descriptor number: 2048 Jan 25 03:26:36.045222 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: lock engine: pthread robust mutexes Jan 25 03:26:36.045222 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: thunder lock: enabled Jan 25 03:26:36.045222 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 25 03:26:36.045222 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 25 03:26:36.091820 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: Python main interpreter initialized at 0x5603e479a9c0 Jan 25 03:26:36.091820 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: python threads support enabled Jan 25 03:26:36.091820 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: your server socket listen backlog is limited to 100 connections Jan 25 03:26:36.091820 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: your mercy for graceful operations on workers is 90 seconds Jan 25 03:26:36.092183 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: mapped 403077 bytes (393 KB) for 2 cores Jan 25 03:26:36.092259 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: *** Operational MODE: preforking *** Jan 25 03:26:36.092473 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: *** uWSGI is running in multiple interpreter mode *** Jan 25 03:26:36.092473 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: spawned uWSGI master process (pid: 102444) Jan 25 03:26:36.092665 dv-cinder-819011-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 25 03:26:36.093566 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: spawned uWSGI worker 1 (pid: 102445, cores: 1) Jan 25 03:26:36.093566 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: spawned uWSGI worker 2 (pid: 102446, cores: 1) Jan 25 03:26:36.093751 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 25 03:26:37.886617 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:26:37.886617 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: from cryptography.utils import int_from_bytes Jan 25 03:26:37.887316 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:26:37.887316 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: from cryptography.utils import int_from_bytes Jan 25 03:26:37.887754 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:26:37.887754 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: from cryptography.utils import int_from_bytes Jan 25 03:26:37.888002 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:26:37.888002 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: from cryptography.utils import int_from_bytes Jan 25 03:26:40.507891 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 03:26:40.508435 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 03:26:40.508539 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 03:26:40.508872 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 03:26:40.508960 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 03:26:40.509031 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 03:26:40.509233 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 03:26:40.509327 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 03:26:40.509625 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 03:26:40.509714 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.509887 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 03:26:40.509987 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.510261 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.510354 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.510593 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.510693 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.510916 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.511023 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.511251 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.511369 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.511576 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.511663 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.511896 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.511983 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.512222 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.512315 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.512487 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.512622 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.512804 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.512910 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.513121 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.513213 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819011-2-iscsi {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.513443 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.513541 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.513753 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.513843 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819011-2-iscsi {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.514064 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.514156 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.514384 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.514474 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.514690 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.514788 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.515012 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.515123 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.515350 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.515461 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.515679 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.515846 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.515996 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.516975 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517079 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517161 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517237 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517304 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517375 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517441 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517515 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517592 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517753 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.517857 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.518082 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.518183 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.518380 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.518476 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.518707 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.518791 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.519023 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.519188 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.519378 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.519474 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819011-2-iscsi {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.519696 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.519791 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.520662 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.520852 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819011-2-iscsi {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.521056 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.521146 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.521286 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.521387 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.521607 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.521703 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.521955 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.522130 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.522279 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.522413 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.522606 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.522707 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.522919 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.523025 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.523273 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.523365 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.523595 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.523686 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.523916 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.524021 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.524239 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.524330 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.524544 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.524642 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.524854 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.524951 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.525163 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.525264 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.525478 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.525574 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.525781 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.525873 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.526089 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.526180 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.526339 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.526436 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.526646 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.526745 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.526945 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.527035 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.527294 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.527385 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.527616 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.527719 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.527883 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.528012 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.528101 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.528254 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.528424 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.528512 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.528746 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.528839 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.529061 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.529148 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.529373 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.529458 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.529683 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.529768 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.529993 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.530079 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.530301 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.530389 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.530611 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.530697 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.530920 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.531078 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.531255 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.531343 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.531568 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.531666 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.531882 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.531990 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.532205 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.532295 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.532517 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.532610 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.532841 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.532939 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.533153 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.533246 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.533475 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.533580 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.533783 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.533869 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.534122 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.534208 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.534435 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.534529 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.534745 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.534829 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.535086 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.535189 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.535408 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.535495 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.536354 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.536463 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.536708 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.536803 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.537027 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.537120 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.537345 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.537431 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.537664 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.537755 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.537994 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.538086 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.538245 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.538330 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.538550 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.538635 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.538866 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.538952 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.539196 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.539294 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.539512 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.539605 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.539820 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.539904 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.540129 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.540214 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.540433 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.540525 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.540743 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.540829 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.541049 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.541139 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.541356 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.541453 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.541666 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.541752 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.541977 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.542062 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.542283 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.542376 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.542590 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.542675 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.542899 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.542995 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.543225 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.543326 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.543540 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.543635 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.543852 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.543937 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.544160 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.544245 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.544470 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.544556 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.544779 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.544864 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.545089 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.545176 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.545404 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.545489 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.545709 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.545793 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.546020 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.546118 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.546334 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.546418 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.546656 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.546788 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.546947 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.547035 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.547290 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.547375 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.547597 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.547681 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.547905 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.547998 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.548219 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.548303 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.548520 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.548609 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.548834 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.548921 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.549143 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.549227 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.549450 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.549540 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.549758 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.549844 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.550061 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.550159 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.550368 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.550459 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.550675 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.550760 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.550981 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.551099 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.551349 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.551514 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.551654 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.551949 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552048 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552128 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552234 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552327 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552544 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552637 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552853 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.552953 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.553168 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.553274 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.553473 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.553574 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.553794 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.553889 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.554112 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.554226 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.554438 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:26:40.554524 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.554778 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.554863 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.555111 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.555199 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.555448 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.555547 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.555783 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.555876 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.556106 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.556192 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.556423 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.556511 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.556742 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.556876 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.557070 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.557161 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.557382 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.557466 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.557696 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.557788 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.558010 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.558095 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.558329 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.558446 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.558648 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.558741 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.558977 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.559076 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.559319 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.559424 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.559639 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.559734 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.559959 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.560052 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.560273 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.560364 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.560592 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.560687 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.560910 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.561003 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.561232 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.561318 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.561546 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.561640 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.561883 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.561968 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.562204 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.562289 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.562523 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.562620 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.562849 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.562944 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.563192 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.563313 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.563519 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.563613 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.563835 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.563935 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.564149 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.564241 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.564462 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.564554 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.564781 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.564872 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.565090 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.565180 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.565403 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.565501 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.565736 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.565859 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.566053 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.566163 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.566369 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.566495 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.566676 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.566764 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.567014 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.567238 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.567329 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.567540 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.567629 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.567713 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.567933 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.568029 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.568255 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.568348 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.568575 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.568660 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.568888 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.568979 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.569222 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.569308 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.569530 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.569621 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.569840 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.569936 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.570150 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.570236 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.570460 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.570546 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.570765 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.570851 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.571104 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.571194 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.571406 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.571492 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.571711 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.571800 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.572026 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.572111 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.572335 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.572420 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.572641 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.572728 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.572962 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.573048 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.573273 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.573374 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.573577 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.573677 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.573890 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.573989 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.574200 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.574300 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.574510 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.574608 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.574821 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.574920 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.575161 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.575265 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.575474 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.575564 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.575785 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.575877 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.576109 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.576208 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.576428 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.576519 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.576732 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.576822 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.577086 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.577197 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.577382 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.577470 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.577702 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.577788 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.578007 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.578094 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.578316 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.578402 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.578622 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.578715 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.578931 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.579018 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.579260 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.579349 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.579572 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.579657 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.579875 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.579961 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.580181 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.580272 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.580483 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.580577 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.580788 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.580875 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.581093 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.581179 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.581402 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.581494 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.581715 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.581800 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.582017 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.582108 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.582321 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.582949 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.583203 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.583359 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.583523 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.583785 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.583872 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.584106 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.584193 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.584462 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.584548 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.584785 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.584878 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.585107 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.585192 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.585422 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.585508 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.585739 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.585836 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.586059 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.586197 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.586365 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.586452 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.586678 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.586776 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.586990 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.587106 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.587335 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.587432 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.587650 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.587744 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.587968 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.588054 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.588278 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.588362 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.588604 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.588698 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.588915 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.589002 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.589235 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.589326 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.589540 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.589634 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.589855 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.589942 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.590187 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.590273 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.590504 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.590590 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.590826 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.590909 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.591169 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.591258 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.591482 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.591569 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.591797 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.591882 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.592106 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.592192 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.592417 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.592504 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.592728 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.592821 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.593039 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.593125 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.593357 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.593444 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.593666 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.593761 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.593981 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.594073 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.594290 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.594382 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.594612 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.594697 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.594931 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.595031 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.595258 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.595346 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.595564 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.595650 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.595877 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.595973 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.596455 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.596546 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.596769 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.596855 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.597084 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.597175 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.597397 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.597482 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.597717 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.597803 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.598047 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.598703 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.599006 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.599108 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.599416 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.599503 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.599734 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.599822 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.600048 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.600141 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.600366 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.600453 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.600681 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.600768 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.600995 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.601087 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.601309 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.601395 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.601620 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.601707 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.601980 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.602071 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.602248 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.602332 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.602556 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.602645 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.602861 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.602947 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.603202 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.603306 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.603516 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.603602 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.603827 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.603912 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.604146 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.604281 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.604472 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.604561 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.604782 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.604868 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.605089 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.605187 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.605416 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.605509 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.605727 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.605812 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.606032 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.606124 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.606339 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.606425 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.606644 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.606729 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.606960 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.607045 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.607308 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.607406 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.607607 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.607692 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.607922 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.608008 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.608244 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.608329 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.608556 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.608687 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.608872 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.608959 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.609183 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.609269 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.609496 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.609583 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.609814 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.609906 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.610128 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.610213 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.610440 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.610534 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.610751 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.610843 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.611099 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.611199 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.611394 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.611489 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.611706 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.611791 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.612022 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.612114 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.612332 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.612424 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.612643 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.612734 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.612955 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.613047 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.613260 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.613353 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.613569 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.613670 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.613912 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.614099 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.614433 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.614542 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.614754 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.614841 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.615107 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.615196 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.615438 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.615683 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.615769 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.616025 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.616110 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.616358 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.616458 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.616674 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.616761 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.617001 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.617094 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.617309 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.617403 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.617623 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.617709 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.617929 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.618015 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.618235 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.618322 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.618548 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.618633 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.618853 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.618938 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.619185 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.619275 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.619496 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.619582 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.619806 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.619891 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.620111 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.620198 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.620421 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.620507 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.620732 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.620824 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.621036 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.621133 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.621345 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.621436 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.621649 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.621734 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.621960 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.622054 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.622265 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.622359 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.622591 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.622677 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.622899 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.622983 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.623228 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.623316 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.623538 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.623625 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.623844 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.623931 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.624172 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.624264 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.624478 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.624563 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.624794 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.624887 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.625104 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.625191 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.625452 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.625544 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.625759 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.625856 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.626066 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.626159 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.626392 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.626483 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.626698 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.626829 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.627005 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.627144 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.627335 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.627428 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.627646 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.627741 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.627954 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.628041 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.628257 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.628343 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.628569 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.628656 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.628880 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.628964 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.629194 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.629314 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.629705 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.629805 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.629885 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.629970 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.630148 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.630234 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.630464 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.630550 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.630778 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.630865 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.631107 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.631197 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.631426 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.631513 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.631730 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.631822 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.632041 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.632136 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.632352 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.632438 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.632656 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.632743 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.632964 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.633065 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.633264 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.633349 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.633581 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.633666 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.633885 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.634023 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.634191 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.634283 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.634494 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.634631 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.634803 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.634898 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.635138 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.635238 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.635443 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.635529 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.635751 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.635836 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.636063 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.636149 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.636367 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.636454 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.636672 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.636758 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.636981 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.637082 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.637284 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.637379 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.637585 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.637671 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.637891 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.637975 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.638207 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.638293 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.638516 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.638603 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.638819 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.638904 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.639155 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.639255 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.639466 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.639551 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.639777 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.639868 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.640070 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.640164 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.640378 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.640470 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.640680 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.640765 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.640983 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.641081 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.641286 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.641373 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.641589 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.641674 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.641891 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.641990 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.642197 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.642287 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.642506 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.642591 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.642805 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.642896 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.643134 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.643223 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.643438 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.643523 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.643766 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.643852 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.644069 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.644152 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.644377 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.644462 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.644685 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.644771 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.645565 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.645659 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.645883 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.646157 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.646250 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.646481 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.646566 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.646798 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.646883 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.647143 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.647233 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.647455 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.647540 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.647773 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.647906 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.648089 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.648182 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.648405 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.648496 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.648711 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.648796 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.649017 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.649103 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.649338 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.649422 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.649648 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.649733 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.649958 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.650049 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.650280 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.650365 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.650596 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.650680 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.650915 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.651000 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.651243 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.651330 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.651557 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.651652 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.651869 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.651965 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.652179 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.652265 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.652491 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.652584 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.652801 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.652887 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.653112 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.653197 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.653425 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.653518 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.653738 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.653822 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.654048 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.654140 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.654363 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.654460 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.654673 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.654794 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.654984 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.655095 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.655334 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.655451 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.655649 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.655764 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.655965 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.656092 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.656281 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.656404 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.656593 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.656711 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.656924 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.657010 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.657241 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.657333 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.657554 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.657639 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.657869 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.657989 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.658181 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.658329 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.658500 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.658645 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.658813 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.658961 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.659274 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.659363 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.659593 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.659688 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.659909 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.660002 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.660221 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.660307 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.660561 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.661151 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.661418 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.661598 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.661747 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.662022 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.662108 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.662343 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.662430 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.662663 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.662786 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.662980 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.663132 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.663315 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.663455 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.663624 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.663776 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.663938 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.664091 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.664267 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.664403 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.664575 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.664723 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.664884 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.665056 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.665191 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.665374 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.665516 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.665689 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.665824 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.666001 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.666149 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.666332 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.666569 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.666663 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.666883 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.666977 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.667271 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.667398 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.667693 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.667781 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.668007 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.668093 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.668322 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.668410 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.668647 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.668733 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.668972 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.669065 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.669299 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.669386 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.669607 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.669694 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.669928 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.670014 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.670240 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.670331 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.670566 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.670652 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.670880 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.670977 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.671217 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.671306 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.671539 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.671625 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.671850 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.671959 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.672171 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.672255 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.672487 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.672572 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.672804 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.673056 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.673153 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.673233 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.673445 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.673531 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.673774 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.673918 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.674155 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.674249 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.674481 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.674568 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.674812 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.674900 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.675167 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.675270 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.675504 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.675591 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.675818 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.675912 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.676131 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.676219 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.676527 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.676613 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.676841 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.676943 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.677153 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.677250 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.677485 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.677583 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.677799 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.677886 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.678119 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.678207 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.678437 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.678522 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.678745 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.678832 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.679101 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.679202 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.679389 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.679476 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.679713 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.679811 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.680024 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.680110 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.680350 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.680436 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.680669 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.680762 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.680979 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.681064 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.681306 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.681393 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.681617 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.681711 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.681923 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.682009 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.682233 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.682327 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.682541 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.682635 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.682850 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.682942 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.683195 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.683300 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.683518 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.683606 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.683852 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.683938 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.684182 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.684269 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.684497 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.684593 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.684833 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.684928 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.685158 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.685246 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.685477 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.685565 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.685796 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.685883 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.686125 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.686220 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.686436 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.686524 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.686742 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.686830 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.687083 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.687191 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.687382 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.687527 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.687690 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.687792 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.687997 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.688092 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.688307 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.688393 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.688609 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.688695 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.688917 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.689012 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.689221 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.689308 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.689530 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.689616 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.689842 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.689936 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.690162 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.690248 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.690472 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.690558 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.690776 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.690872 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.691104 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.691205 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.691413 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.691510 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.691726 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.691853 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.692067 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.692159 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.692417 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.692659 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.692756 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.692983 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.693081 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.693309 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.693396 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.693640 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.693735 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.693953 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.694042 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.694280 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.694368 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.694600 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.694694 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.694923 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.695017 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.695263 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.695351 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.695582 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.695677 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.695901 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.695987 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.696219 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.696306 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.696537 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.696626 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.696851 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.696938 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.697166 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.697253 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.697480 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.697621 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.697799 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.697885 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.698122 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.698315 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.698644 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.698731 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.698962 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.699081 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.699301 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.699404 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.699617 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.699711 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.699938 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.700026 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.700252 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.700349 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.700566 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.700653 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.700879 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.700972 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.701193 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.701281 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.701505 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.701592 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.701821 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.701908 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.702146 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.702233 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.702473 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.702569 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.702807 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.702893 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.703156 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.703284 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.703474 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.703573 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.703791 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.703886 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.704106 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.704193 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.704439 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.704561 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.704770 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.704868 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.705081 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.705168 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.705400 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.705486 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.705719 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.705806 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.706034 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.706121 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.706348 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.706435 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.706661 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.706755 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.706977 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.707087 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.707322 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.708024 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.708155 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.708329 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.708477 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.708648 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.708795 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.708968 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.709118 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.709286 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.709437 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.709614 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.709768 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.709950 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.710109 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.710273 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.710433 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.710595 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.710754 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.710911 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.711089 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.711261 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.711415 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.711778 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.711942 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.712093 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.712264 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.712429 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.712607 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.712762 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.712945 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.713087 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.713280 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.713405 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.713605 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.713728 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.713933 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.714057 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.714272 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.714359 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.714589 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.714684 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.714905 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.714994 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.715253 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.715341 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.715576 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.715671 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.715889 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.715982 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.716198 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.716284 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.716504 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.716600 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.716825 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.716912 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.717135 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.717221 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.717453 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.717663 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.717991 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.718079 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.718318 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.718404 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.718647 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.718738 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.718975 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.719109 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.719317 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.719414 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.719625 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.719743 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.719948 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.720034 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.720255 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.720341 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.720567 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.720654 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.720881 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.720968 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.721447 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.721538 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.721753 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.721847 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.722059 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.722153 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.722369 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.722466 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.722676 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.722774 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.722982 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.723144 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.723361 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.723953 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.724156 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.724252 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.724484 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.724577 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.724790 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.724887 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.725097 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.725191 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.725403 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.725490 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.725715 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.725810 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.726022 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.726108 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.726328 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.726416 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.726634 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.726721 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.726940 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.727026 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.727277 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.727364 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.727583 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.727676 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.727892 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.727979 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.728198 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.728284 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.728508 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.728605 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.728810 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.728906 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.729120 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.729214 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.729426 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.729514 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.729735 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.729821 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.730039 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.730130 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.730342 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.730430 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.730659 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.730751 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.730966 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.731109 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.731311 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.731398 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.731622 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.731708 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.731934 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.732031 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.732251 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.732337 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.732581 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.732674 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.732914 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.733150 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.733486 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.733572 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.733806 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.733905 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.734136 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.734229 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.734466 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.734552 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.734775 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.734871 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.735097 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.735188 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.735406 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.735493 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.735731 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.735828 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.736045 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.736134 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.736358 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.736445 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.736670 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.736758 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.736982 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.737071 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.737290 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.737378 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.737601 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.737696 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.737913 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.738000 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.738223 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.738353 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.738535 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.738631 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.738873 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.739027 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.739255 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.739618 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.739706 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.739961 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.740108 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.740284 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.740440 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.740610 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.740795 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.740931 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.741127 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.741251 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.741458 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.741565 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.741788 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.741875 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.742117 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.742203 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.742438 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.742524 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.742756 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.742844 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.743100 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.743200 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.743419 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.743513 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.743724 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.743811 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.744063 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.744151 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.744385 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.744479 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.744699 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.744785 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.745052 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.745175 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.745365 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.745524 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.745689 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.745819 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.746012 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.746107 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.746324 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.746412 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.746647 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.746734 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.746958 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.747050 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.747314 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.747412 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.747653 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.747740 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.747971 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.748064 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.748297 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.748384 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.748604 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.748691 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.748911 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.748998 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.749217 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.749314 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.749527 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.749616 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.749857 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.749953 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.750179 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.750264 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.750497 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.750582 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.750820 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.750915 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.751161 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.751252 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.751487 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.751575 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.751798 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.751893 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.752118 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.752204 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.752438 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.752525 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.752753 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.752839 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.753061 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.753183 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.753390 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.753476 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.753702 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.753789 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.754013 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.754107 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.754370 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.754523 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.754673 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.754909 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.755096 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.755264 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.755394 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.755588 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.755725 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.755908 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.756053 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.756228 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.756363 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.756548 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.756691 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.756883 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.757010 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.757217 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.757314 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.757531 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.757619 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.757863 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.757950 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.758187 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.758275 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.758516 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.758603 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.758840 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.758933 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.759172 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.759281 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.759488 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.759575 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.759805 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.759892 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.760122 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.760217 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.760438 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.760524 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.760761 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.760847 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.761086 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.761180 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.761407 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.761493 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.761740 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.761827 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.762055 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.762141 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.762393 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.762478 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.762720 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.762814 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.763036 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.763152 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.763375 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.763463 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.763681 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.763774 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.763925 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 03:26:40.764061 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.764384 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.764703 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.765017 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:26:40.765268 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 03:26:40.787863 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_db.sqlalchemy.engines [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:40.788693 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_db.sqlalchemy.engines [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:40.850736 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.context [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cb78da0-bb01-419a-a509-9b31671d00b0(cell1) {{(pid=102445) load_cells /opt/stack/nova/nova/context.py:464}} Jan 25 03:26:40.851929 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.context [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cb78da0-bb01-419a-a509-9b31671d00b0(cell1) {{(pid=102446) load_cells /opt/stack/nova/nova/context.py:464}} Jan 25 03:26:40.855045 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_concurrency.lockutils [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:26:40.856090 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:26:40.856610 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_concurrency.lockutils [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:26:40.857423 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_concurrency.lockutils [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:26:40.857682 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:26:40.858505 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:26:40.859479 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_concurrency.lockutils [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:26:40.860458 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:26:40.870031 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_db.sqlalchemy.engines [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:40.873272 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_db.sqlalchemy.engines [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:40.875719 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_db.sqlalchemy.engines [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:40.878072 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_db.sqlalchemy.engines [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:41.032630 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG oslo_db.sqlalchemy.engines [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:41.037374 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_db.sqlalchemy.engines [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:26:41.469281 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: WARNING keystonemiddleware.auth_token [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:26:41.476410 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: WARNING keystonemiddleware.auth_token [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:26:41.516670 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: WARNING keystonemiddleware.auth_token [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:26:41.523222 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: WARNING keystonemiddleware.auth_token [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:26:41.841738 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: WARNING keystonemiddleware.auth_token [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:26:41.847202 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: WARNING keystonemiddleware.auth_token [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:26:41.853509 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5603e479a9c0 pid: 102445 (default app) Jan 25 03:26:41.855586 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:26:41.856772 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] 10.222.0.115 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001763 Jan 25 03:26:41.857194 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 1/1] 10.222.0.115 () {50 vars in 793 bytes} [Tue Jan 25 03:26:41 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:26:41.874205 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: WARNING keystonemiddleware.auth_token [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:26:41.880334 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: WARNING keystonemiddleware.auth_token [None req-18c4842b-9380-4f86-81fe-76485687b1cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:26:41.886764 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5603e479a9c0 pid: 102446 (default app) Jan 25 03:28:10.475950 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:10.476964 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001445 Jan 25 03:28:10.477374 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 2/2] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:10.909966 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-79351d09-8dcc-4995-8059-6e3e6c6ac965 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:10.940824 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-79351d09-8dcc-4995-8059-6e3e6c6ac965 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.456735 Jan 25 03:28:10.941634 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 1/3] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Jan 25 03:28:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:28:13.269871 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:13.270858 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-643d4fb5-f797-4b2a-a3e1-b5502f249d6f None None] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001409 Jan 25 03:28:13.271506 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 3/4] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:13 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:13.330095 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-1614d285-5668-4865-aa3d-feb4d3e7cd9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:13.348352 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:28:13.348352 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: warnings.warn(msg) Jan 25 03:28:13.448479 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-1614d285-5668-4865-aa3d-feb4d3e7cd9e admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.171027 Jan 25 03:28:13.449226 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 2/5] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:28:13.665136 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-1630717c-7cb4-4df8-88a8-22ebde4aa6ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:13.667527 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:28:13.667527 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: warnings.warn(msg) Jan 25 03:28:13.771129 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-1630717c-7cb4-4df8-88a8-22ebde4aa6ee admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313745 Jan 25 03:28:13.771931 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 4/6] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Jan 25 03:28:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:28:16.081036 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-1614d285-5668-4865-aa3d-feb4d3e7cd9e admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:16.082075 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-1614d285-5668-4865-aa3d-feb4d3e7cd9e admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001493 Jan 25 03:28:16.082503 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 3/7] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:16.190864 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-51840f94-e603-4058-b84b-45bae1a7e100 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:16.210382 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:28:16.210382 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: warnings.warn(msg) Jan 25 03:28:16.302673 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-51840f94-e603-4058-b84b-45bae1a7e100 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.214155 Jan 25 03:28:16.303616 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 5/8] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:28:16.315912 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-8d9a3ded-7dca-48fa-96b7-bf166b54ed9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:16.317526 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:28:16.317526 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: warnings.warn(msg) Jan 25 03:28:16.426762 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-8d9a3ded-7dca-48fa-96b7-bf166b54ed9d admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114872 Jan 25 03:28:16.429220 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 4/9] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Jan 25 03:28:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:28:18.741879 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-51840f94-e603-4058-b84b-45bae1a7e100 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:18.742933 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-51840f94-e603-4058-b84b-45bae1a7e100 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001464 Jan 25 03:28:18.743454 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 6/10] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:18 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:18.811627 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-b858e440-1078-49b9-a0b7-4d6428401f21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:18.873324 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-b858e440-1078-49b9-a0b7-4d6428401f21 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.124028 Jan 25 03:28:18.874210 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 5/11] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:28:18.886017 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-b664fea7-0115-40d1-82b0-3f807c030ba5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:18.962015 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-b664fea7-0115-40d1-82b0-3f807c030ba5 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079477 Jan 25 03:28:18.962898 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 7/12] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Jan 25 03:28:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:28:21.246126 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-b858e440-1078-49b9-a0b7-4d6428401f21 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:21.247173 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-b858e440-1078-49b9-a0b7-4d6428401f21 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001469 Jan 25 03:28:21.247740 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 6/13] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:21 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:21.308768 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-a216fcf8-4ed1-4718-81af-c2119dbf4bf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "ram": 2048, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:21.386648 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-a216fcf8-4ed1-4718-81af-c2119dbf4bf7 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133114 Jan 25 03:28:21.387309 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 8/14] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:28:21.399833 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-d0b1d9a7-9d19-4d5b-8f37-6f9c90206409 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:21.487969 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-d0b1d9a7-9d19-4d5b-8f37-6f9c90206409 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091906 Jan 25 03:28:21.488512 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 7/15] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Jan 25 03:28:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:28:23.760130 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-a216fcf8-4ed1-4718-81af-c2119dbf4bf7 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:23.761128 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-a216fcf8-4ed1-4718-81af-c2119dbf4bf7 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001426 Jan 25 03:28:23.761525 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 9/16] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:23 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:23.819350 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-bf9eb931-992b-4f10-a91e-8f03fa01cdbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:23.895484 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-bf9eb931-992b-4f10-a91e-8f03fa01cdbb admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.127530 Jan 25 03:28:23.896028 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 8/17] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:28:23.908216 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-d8c3d6e8-facd-46af-a59e-56916fb5bfd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:23.967262 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-d8c3d6e8-facd-46af-a59e-56916fb5bfd2 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063120 Jan 25 03:28:23.983083 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 10/18] 10.222.0.115 () {64 vars in 1340 bytes} [Tue Jan 25 03:28:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:28:26.271783 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-bf9eb931-992b-4f10-a91e-8f03fa01cdbb admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:26.272818 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-bf9eb931-992b-4f10-a91e-8f03fa01cdbb admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001565 Jan 25 03:28:26.273230 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 9/19] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:26.334755 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-174e6108-9672-40bd-89c4-461bae72d2ff admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:26.362227 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-174e6108-9672-40bd-89c4-461bae72d2ff admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.082498 Jan 25 03:28:26.375757 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 11/20] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Jan 25 03:28:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:28:28.713900 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-bf9eb931-992b-4f10-a91e-8f03fa01cdbb admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:28.715945 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-bf9eb931-992b-4f10-a91e-8f03fa01cdbb admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002818 Jan 25 03:28:28.716688 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 10/21] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:28 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:28.781739 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-de809a71-5828-4b49-82a2-882ad5477819 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:28.889673 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-de809a71-5828-4b49-82a2-882ad5477819 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165894 Jan 25 03:28:28.890155 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 12/22] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:28:28.902263 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-88ee9886-b503-4c2b-be52-6dd57a2ac9f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:28.961949 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-88ee9886-b503-4c2b-be52-6dd57a2ac9f1 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063289 Jan 25 03:28:28.962562 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 11/23] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Jan 25 03:28:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:28:31.286271 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-de809a71-5828-4b49-82a2-882ad5477819 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:31.287353 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-de809a71-5828-4b49-82a2-882ad5477819 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001515 Jan 25 03:28:31.287778 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 13/24] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:31 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:28:31.351198 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-d18d7dec-acd0-4dcb-9c59-e709a1282bc8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 2048}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:31.645389 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-d18d7dec-acd0-4dcb-9c59-e709a1282bc8 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.351423 Jan 25 03:28:31.646083 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 12/25] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:28:31.659481 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-591ba0a4-96be-476b-aa97-a4d2afc53f68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:31.744530 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-591ba0a4-96be-476b-aa97-a4d2afc53f68 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089558 Jan 25 03:28:31.745289 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 14/26] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Jan 25 03:28:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:28:34.046900 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-d18d7dec-acd0-4dcb-9c59-e709a1282bc8 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:34.047947 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-d18d7dec-acd0-4dcb-9c59-e709a1282bc8 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001652 Jan 25 03:28:34.048361 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 13/27] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:34 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:34.105628 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-20510545-4b3a-48ea-81ca-3da1f7a7e12d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "swap": 0}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:34.204596 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-20510545-4b3a-48ea-81ca-3da1f7a7e12d admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.150567 Jan 25 03:28:34.205152 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 15/28] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:28:34.217257 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-1a173235-c275-42d8-8533-6f89fa3ef6d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:34.287311 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-1a173235-c275-42d8-8533-6f89fa3ef6d9 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073982 Jan 25 03:28:34.287825 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 14/29] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Jan 25 03:28:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:28:36.655602 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-20510545-4b3a-48ea-81ca-3da1f7a7e12d admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:36.688414 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-20510545-4b3a-48ea-81ca-3da1f7a7e12d admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003148 Jan 25 03:28:36.688414 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 16/30] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:36 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:36.780179 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-a105ca20-9689-43cd-8ace-025a07865335 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:37.436458 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-a105ca20-9689-43cd-8ace-025a07865335 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.769083 Jan 25 03:28:37.437659 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 15/31] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:28:37.449303 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-905f5785-449b-4d61-8091-338d91c749da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:37.555896 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-905f5785-449b-4d61-8091-338d91c749da admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110095 Jan 25 03:28:37.556940 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 17/32] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Jan 25 03:28:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:28:39.882762 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-a105ca20-9689-43cd-8ace-025a07865335 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:28:39.883827 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-a105ca20-9689-43cd-8ace-025a07865335 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001505 Jan 25 03:28:39.888890 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 16/33] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:28:39 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:28:39.954178 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-5c359530-40ee-4dd9-9411-fbd14ae3c0b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "swap": 0}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:40.031854 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-5c359530-40ee-4dd9-9411-fbd14ae3c0b6 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.136919 Jan 25 03:28:40.033298 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 18/34] 10.222.0.115 () {64 vars in 1287 bytes} [Tue Jan 25 03:28:39 2022] POST /compute/v2.1/flavors => generated 410 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:28:40.044969 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-9af65a8d-8f3b-448d-9a91-ee5f67e8ecd3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:28:40.121337 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-9af65a8d-8f3b-448d-9a91-ee5f67e8ecd3 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079902 Jan 25 03:28:40.121843 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 17/35] 10.222.0.115 () {64 vars in 1337 bytes} [Tue Jan 25 03:28:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:29:02.996446 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-5c359530-40ee-4dd9-9411-fbd14ae3c0b6 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:02.997465 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-5c359530-40ee-4dd9-9411-fbd14ae3c0b6 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Jan 25 03:29:02.997899 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 19/36] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:29:02 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:03.056953 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-165d4c70-c972-42bc-9846-7c81c1dd9546 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:03.073884 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-165d4c70-c972-42bc-9846-7c81c1dd9546 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.069563 Jan 25 03:29:03.074424 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 18/37] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Jan 25 03:29:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:29:04.451240 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-5c359530-40ee-4dd9-9411-fbd14ae3c0b6 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:04.452249 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-5c359530-40ee-4dd9-9411-fbd14ae3c0b6 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Jan 25 03:29:04.452647 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 20/38] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:04.647126 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-38f4a8dd-9e04-4090-abd6-5403f7cecf47 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:04.652815 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.wsgi [None req-38f4a8dd-9e04-4090-abd6-5403f7cecf47 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 25 03:29:04.653391 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-38f4a8dd-9e04-4090-abd6-5403f7cecf47 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:29:04.654196 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-38f4a8dd-9e04-4090-abd6-5403f7cecf47 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061616 Jan 25 03:29:04.654714 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 19/39] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Jan 25 03:29:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:04.664420 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-16b9e986-1fee-4863-b071-34a63a8adda4 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:04.685379 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-16b9e986-1fee-4863-b071-34a63a8adda4 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024518 Jan 25 03:29:04.685916 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 21/40] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Jan 25 03:29:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:29:04.695711 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-0cec6c5d-ba85-4135-b5ca-67940b7c8bda admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:04.716770 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-0cec6c5d-ba85-4135-b5ca-67940b7c8bda admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024299 Jan 25 03:29:04.717296 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 20/41] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Jan 25 03:29:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:29:04.726931 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-f4dde024-1d4a-4a1f-a43b-0bddac9d7e42 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:04.732431 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.wsgi [None req-f4dde024-1d4a-4a1f-a43b-0bddac9d7e42 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 25 03:29:04.733010 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-f4dde024-1d4a-4a1f-a43b-0bddac9d7e42 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:29:04.733804 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-f4dde024-1d4a-4a1f-a43b-0bddac9d7e42 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010416 Jan 25 03:29:04.734307 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 22/42] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Jan 25 03:29:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:06.022684 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-0cec6c5d-ba85-4135-b5ca-67940b7c8bda admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:06.023757 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-0cec6c5d-ba85-4135-b5ca-67940b7c8bda admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001523 Jan 25 03:29:06.024156 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 21/43] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:06.218112 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-4ff99ab1-125b-4315-89ee-71c7b939e7ca admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:06.223769 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.wsgi [None req-4ff99ab1-125b-4315-89ee-71c7b939e7ca admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 25 03:29:06.224328 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-4ff99ab1-125b-4315-89ee-71c7b939e7ca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:29:06.225135 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-4ff99ab1-125b-4315-89ee-71c7b939e7ca admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059052 Jan 25 03:29:06.225611 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 23/44] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Jan 25 03:29:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:06.234677 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-381aac69-cb2f-4620-ba8d-13906603700b admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:06.248346 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-381aac69-cb2f-4620-ba8d-13906603700b admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017132 Jan 25 03:29:06.248859 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 22/45] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Jan 25 03:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:29:06.258432 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-393e0e38-a37c-44dc-a122-c3a8d75498c1 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:06.272533 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-393e0e38-a37c-44dc-a122-c3a8d75498c1 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017658 Jan 25 03:29:06.273054 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 24/46] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Jan 25 03:29:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:29:06.282543 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-d5e17e72-b8ab-4627-be14-bf64cae4cda5 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:06.287688 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.wsgi [None req-d5e17e72-b8ab-4627-be14-bf64cae4cda5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 25 03:29:06.288244 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-d5e17e72-b8ab-4627-be14-bf64cae4cda5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:29:06.289044 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-d5e17e72-b8ab-4627-be14-bf64cae4cda5 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010525 Jan 25 03:29:06.289523 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 23/47] 10.222.0.115 () {60 vars in 1195 bytes} [Tue Jan 25 03:29:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 25 03:29:07.560081 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-393e0e38-a37c-44dc-a122-c3a8d75498c1 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:07.561147 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-393e0e38-a37c-44dc-a122-c3a8d75498c1 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Jan 25 03:29:07.561547 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 25/48] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:07 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:07.755140 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-0ce4cc1e-e0a9-487a-9900-8612d5680837 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:07.760792 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.wsgi [None req-0ce4cc1e-e0a9-487a-9900-8612d5680837 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 25 03:29:07.761357 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-0ce4cc1e-e0a9-487a-9900-8612d5680837 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:29:07.762152 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-0ce4cc1e-e0a9-487a-9900-8612d5680837 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058276 Jan 25 03:29:07.762670 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 24/49] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Jan 25 03:29:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:07.772913 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-4c95a147-e905-4c09-b3e2-714981391e1a admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:07.786873 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-4c95a147-e905-4c09-b3e2-714981391e1a admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017587 Jan 25 03:29:07.787475 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 26/50] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Jan 25 03:29:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:29:07.797437 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:07.810456 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017069 Jan 25 03:29:07.810989 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 25/51] 10.222.0.115 () {60 vars in 1215 bytes} [Tue Jan 25 03:29:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:29:07.825085 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-ab323f01-de18-4a4e-81d1-5e2f58d97120 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:07.831496 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.wsgi [None req-ab323f01-de18-4a4e-81d1-5e2f58d97120 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 25 03:29:07.832068 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-ab323f01-de18-4a4e-81d1-5e2f58d97120 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:29:07.832856 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-ab323f01-de18-4a4e-81d1-5e2f58d97120 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012411 Jan 25 03:29:07.833365 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 27/52] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Jan 25 03:29:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 25 03:29:09.141755 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:09.142782 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001756 Jan 25 03:29:09.143211 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 26/53] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:09 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:09.332294 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-2ef46263-6de4-4b3d-9c7b-dcfeca462b09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:29:09.413337 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-2ef46263-6de4-4b3d-9c7b-dcfeca462b09 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.131470 Jan 25 03:29:09.413886 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 28/54] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Jan 25 03:29:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:29:10.710956 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:10.711984 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001437 Jan 25 03:29:10.712381 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 27/55] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:10.907412 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-1da42789-db97-43fc-917b-8c3252d26c70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:29:10.956101 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-1da42789-db97-43fc-917b-8c3252d26c70 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.100083 Jan 25 03:29:10.956654 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 29/56] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Jan 25 03:29:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:29:12.223676 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:12.224797 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001466 Jan 25 03:29:12.225121 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 28/57] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:12.417937 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-022b29a6-fd0a-4d24-affc-fd11ba7ec9d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:29:12.505497 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-022b29a6-fd0a-4d24-affc-fd11ba7ec9d8 admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.138186 Jan 25 03:29:12.506044 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 30/58] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Jan 25 03:29:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:29:13.789788 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:13.790807 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001404 Jan 25 03:29:13.791239 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 29/59] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:13.981366 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-1597cbd0-c731-4646-9732-fba76d6b2e9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:29:14.046914 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-1597cbd0-c731-4646-9732-fba76d6b2e9e admin admin] 10.222.0.115 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.116103 Jan 25 03:29:14.047894 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 31/60] 10.222.0.115 () {64 vars in 1240 bytes} [Tue Jan 25 03:29:13 2022] POST /compute/v2.1/flavors => generated 411 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:29:15.348396 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:15.349407 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001430 Jan 25 03:29:15.349958 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 30/61] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:29:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:29:15.541643 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-899e6050-c6a7-4611-a18c-db247124e061 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:29:15.561371 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-899e6050-c6a7-4611-a18c-db247124e061 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.070257 Jan 25 03:29:15.561832 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 32/62] 10.222.0.115 () {60 vars in 1207 bytes} [Tue Jan 25 03:29:15 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:30:02.135183 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:30:02.136191 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-e80f4092-3b88-4c48-bfb2-d1ff8ea08699 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 Jan 25 03:30:02.136595 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 31/63] 10.222.0.115 () {54 vars in 935 bytes} [Tue Jan 25 03:30:02 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:30:02.193237 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-5e4ba2ba-40d9-4209-9719-e8ddd35d9322 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:30:02.213861 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-5e4ba2ba-40d9-4209-9719-e8ddd35d9322 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.071527 Jan 25 03:30:02.214655 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 33/64] 10.222.0.115 () {60 vars in 1296 bytes} [Tue Jan 25 03:30:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:30:02.238003 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-00a6435a-4358-4ee2-b8f0-bb630996c666 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:30:02.247694 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-00a6435a-4358-4ee2-b8f0-bb630996c666 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011203 Jan 25 03:30:02.247694 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 32/65] 10.222.0.115 () {60 vars in 1287 bytes} [Tue Jan 25 03:30:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:30:02.257445 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-e33b6d58-0cd5-43f6-85f4-bd3ef15440e7 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:30:02.265000 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-e33b6d58-0cd5-43f6-85f4-bd3ef15440e7 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011134 Jan 25 03:30:02.265505 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 34/66] 10.222.0.115 () {60 vars in 1290 bytes} [Tue Jan 25 03:30:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:30:02.276160 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-46a6c7de-889e-489a-8fe8-6fa74313da42 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:30:02.284654 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-46a6c7de-889e-489a-8fe8-6fa74313da42 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011925 Jan 25 03:30:02.285173 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 33/67] 10.222.0.115 () {60 vars in 1290 bytes} [Tue Jan 25 03:30:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:30:02.296781 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:30:02.304355 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] 10.222.0.115 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011723 Jan 25 03:30:02.304873 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 35/68] 10.222.0.115 () {60 vars in 1287 bytes} [Tue Jan 25 03:30:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:32:00.382266 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-65a2aa7f-417f-4c69-bf9b-ce2d70f0a891 tempest-verify_tempest_config-1282458061 tempest-verify_tempest_config-1282458061-project] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:32:00.384343 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-65a2aa7f-417f-4c69-bf9b-ce2d70f0a891 tempest-verify_tempest_config-1282458061 tempest-verify_tempest_config-1282458061-project] 10.222.0.115 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108568 Jan 25 03:32:00.384865 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 34/69] 10.222.0.115 () {58 vars in 1138 bytes} [Tue Jan 25 03:32:00 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:33:33.987832 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:33.988854 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001493 Jan 25 03:33:33.989274 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 36/70] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:33:33 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:33:34.243799 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-5d6379f8-d70f-49d0-9801-68a778a65bd5 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:34.245008 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:33:34.245008 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: warnings.warn(msg) Jan 25 03:33:34.246563 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-5d6379f8-d70f-49d0-9801-68a778a65bd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:34.247004 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-5d6379f8-d70f-49d0-9801-68a778a65bd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:34.247826 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-5d6379f8-d70f-49d0-9801-68a778a65bd5 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:34.248250 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-5d6379f8-d70f-49d0-9801-68a778a65bd5 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:34.281962 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-5d6379f8-d70f-49d0-9801-68a778a65bd5 admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149337 Jan 25 03:33:34.282510 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 35/71] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Jan 25 03:33:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:33:35.604767 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:35.606064 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002268 Jan 25 03:33:35.606463 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 37/72] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:33:35 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:33:35.804234 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-929712be-b33a-4e86-9be5-c7ed2dbb5450 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:35.805448 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:33:35.805448 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: warnings.warn(msg) Jan 25 03:33:35.806989 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-929712be-b33a-4e86-9be5-c7ed2dbb5450 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:35.807620 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-929712be-b33a-4e86-9be5-c7ed2dbb5450 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:35.809065 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-929712be-b33a-4e86-9be5-c7ed2dbb5450 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:35.809791 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-929712be-b33a-4e86-9be5-c7ed2dbb5450 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:35.828751 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-929712be-b33a-4e86-9be5-c7ed2dbb5450 admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076253 Jan 25 03:33:35.829218 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 36/73] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Jan 25 03:33:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:33:47.545774 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:47.546775 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001417 Jan 25 03:33:47.547206 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 38/74] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:33:47 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:33:47.742985 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-82f75f3c-07cd-47a0-b605-44d68e8f2ab2 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:47.744207 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:33:47.744207 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: warnings.warn(msg) Jan 25 03:33:47.745889 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-82f75f3c-07cd-47a0-b605-44d68e8f2ab2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:47.746295 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-82f75f3c-07cd-47a0-b605-44d68e8f2ab2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:47.747138 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-82f75f3c-07cd-47a0-b605-44d68e8f2ab2 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:47.747574 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-82f75f3c-07cd-47a0-b605-44d68e8f2ab2 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:47.773129 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-82f75f3c-07cd-47a0-b605-44d68e8f2ab2 admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082952 Jan 25 03:33:47.773687 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 37/75] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Jan 25 03:33:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:33:49.075170 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: DEBUG nova.api.openstack.wsgi [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] Calling method '>' {{(pid=102445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:49.076202 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: INFO nova.api.openstack.requestlog [None req-41036bc5-7e55-4859-ab61-87e07a281b47 admin admin] 10.222.0.115 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001475 Jan 25 03:33:49.076599 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: [pid: 102445|app: 0|req: 39/76] 10.222.0.115 () {56 vars in 1079 bytes} [Tue Jan 25 03:33:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:33:49.272829 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG nova.api.openstack.wsgi [None req-dac0ba04-8d56-427e-ae71-05099c4d38c2 admin admin] Calling method '>' {{(pid=102446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:33:49.273993 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:33:49.273993 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: warnings.warn(msg) Jan 25 03:33:49.275534 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-dac0ba04-8d56-427e-ae71-05099c4d38c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:49.275970 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-dac0ba04-8d56-427e-ae71-05099c4d38c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:49.276755 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-dac0ba04-8d56-427e-ae71-05099c4d38c2 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:33:49.277180 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: DEBUG oslo_concurrency.lockutils [None req-dac0ba04-8d56-427e-ae71-05099c4d38c2 admin admin] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:33:49.299688 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: INFO nova.api.openstack.requestlog [None req-dac0ba04-8d56-427e-ae71-05099c4d38c2 admin admin] 10.222.0.115 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.076741 Jan 25 03:33:49.300173 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: [pid: 102446|app: 0|req: 38/77] 10.222.0.115 () {60 vars in 1198 bytes} [Tue Jan 25 03:33:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:34:46.913418 dv-cinder-819011-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 25 03:34:46.914086 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: Tue Jan 25 03:34:46 2022 - graceful shutdown triggered... Jan 25 03:34:46.914549 dv-cinder-819011-2-iscsi devstack@n-api.service[102445]: Gracefully killing worker 1 (pid: 102445)... Jan 25 03:34:46.916665 dv-cinder-819011-2-iscsi devstack@n-api.service[102446]: Gracefully killing worker 2 (pid: 102446)... Jan 25 03:34:47.915187 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: worker 1 buried after 1 seconds Jan 25 03:34:47.915796 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: worker 2 buried after 1 seconds Jan 25 03:34:47.915796 dv-cinder-819011-2-iscsi devstack@n-api.service[102444]: goodbye to uWSGI. Jan 25 03:34:47.916779 dv-cinder-819011-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 25 03:34:47.917322 dv-cinder-819011-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 25 03:34:47.920185 dv-cinder-819011-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 25 03:34:47.929765 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 25 03:34:47 2022] *** Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: nodename: dv-cinder-819011-2-iscsi Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: machine: x86_64 Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: clock source: unix Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: pcre jit disabled Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: detected number of CPU cores: 4 Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: current working directory: / Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: detected binary path: /usr/bin/uwsgi-core Jan 25 03:34:47.932410 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: your processes number limit is 47680 Jan 25 03:34:47.933251 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: your memory page size is 4096 bytes Jan 25 03:34:47.933251 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: detected max file descriptor number: 2048 Jan 25 03:34:47.933251 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: lock engine: pthread robust mutexes Jan 25 03:34:47.933251 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: thunder lock: enabled Jan 25 03:34:47.933251 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 25 03:34:47.933251 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 25 03:34:47.979494 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: Python main interpreter initialized at 0x55bfc49de9c0 Jan 25 03:34:47.979494 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: python threads support enabled Jan 25 03:34:47.979494 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: your server socket listen backlog is limited to 100 connections Jan 25 03:34:47.979494 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: your mercy for graceful operations on workers is 90 seconds Jan 25 03:34:47.979922 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: mapped 403077 bytes (393 KB) for 2 cores Jan 25 03:34:47.980000 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: *** Operational MODE: preforking *** Jan 25 03:34:47.980245 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: *** uWSGI is running in multiple interpreter mode *** Jan 25 03:34:47.980245 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: spawned uWSGI master process (pid: 123346) Jan 25 03:34:47.980455 dv-cinder-819011-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 25 03:34:47.987100 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: spawned uWSGI worker 1 (pid: 123362, cores: 1) Jan 25 03:34:47.987100 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: spawned uWSGI worker 2 (pid: 123363, cores: 1) Jan 25 03:34:47.987100 dv-cinder-819011-2-iscsi devstack@n-api.service[123346]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 25 03:34:49.975434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:34:49.975434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: from cryptography.utils import int_from_bytes Jan 25 03:34:49.976116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:34:49.976116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: from cryptography.utils import int_from_bytes Jan 25 03:34:49.983487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:34:49.983487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: from cryptography.utils import int_from_bytes Jan 25 03:34:49.984003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 25 03:34:49.984003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: from cryptography.utils import int_from_bytes Jan 25 03:34:55.186055 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 03:34:55.186724 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 03:34:55.187008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 03:34:55.187240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 03:34:55.187495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 03:34:55.187891 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.188229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.188563 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.188893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.189233 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.189551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.189879 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.190204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.190537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.190803 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.191155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.191495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819011-2-iscsi {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.191830 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.192015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 25 03:34:55.192396 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.192481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 25 03:34:55.192597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.192794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.192900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 25 03:34:55.193070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.193157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 25 03:34:55.193385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 25 03:34:55.193493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.193695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.193803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.196406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.196406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.196658 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.197484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.197612 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.197887 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.198138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.198386 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.198601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.198838 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.199153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.199720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.199986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.200216 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.200442 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.200650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.200874 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.201224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.201516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.201516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.201967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.202185 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819011-2-iscsi {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.202397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819011-2-iscsi {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.202617 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.202839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.203357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.203357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.203863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.204043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.204043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.204395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.204588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.204744 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.204899 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.205052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.205052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.205385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.205583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.205816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.205816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.206284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.206439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.206586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.206773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.206932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.206932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.207261 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.207418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.207576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.207740 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.207886 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.208045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.208210 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.208367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.208520 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.209435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.209619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.209768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.209768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.210081 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819011-2-iscsi {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.210308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.210478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.210634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.210792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.211167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.211322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.211467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.211467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.211948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.212104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.212253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.212407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.212553 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.212720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.212948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.213103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.213259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.213412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.213566 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.213724 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.213876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.214023 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.214174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.214329 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.214475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.214650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.214797 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.214951 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.215688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.215844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.215990 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.216150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.216307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.216538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.216538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.216823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.216986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.217140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.217140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.217454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.217607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.217762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.217922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.218076 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.218229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.218385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.218385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.218667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.218986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.219528 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.219699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.219857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.220013 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.220175 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.220332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.220477 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.220634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.220779 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.220925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.221218 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.221381 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.221535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.221692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.221945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.222213 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.222381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.222605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.222761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.222915 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.223185 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.223353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.223542 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.223699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.223699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.223983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.224149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.224306 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.224459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.224612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.224759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.224904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.225060 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.225220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.225375 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.225524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.225670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.225670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.225952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.115 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.226117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.226270 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.115 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.226417 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.226604 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.227532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.227706 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.227864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.228010 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.228164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.228164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.228458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.228614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.228614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.228937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.229194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.229745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.229911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.229911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.230263 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.230410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.230561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.231477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.231477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.231785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.231958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.232237 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.232516 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.232669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.232814 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.232958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.233110 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.233262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.233424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.233577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.233732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.233887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.234041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.234041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.234344 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.234491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.234643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.234643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.234942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.235121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.235274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.235418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.235418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.235720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.235882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.235882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.236185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.236341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.236495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.236650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.236805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.236960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.237106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.237250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.237394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.237622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.237777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.237935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.238087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.238232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.238399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.238558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.238711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.238867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.239021 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.239218 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.239471 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.239970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.240128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.240274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.240420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.240578 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.240724 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.240886 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.241040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.241186 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.241345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.241508 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.241736 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.241887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.242040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.242223 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.242444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.242717 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.242870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.243026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.243265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.243430 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.243576 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.243720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.243870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.244023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.244176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.244336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.244489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.244634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.244785 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.244938 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.245103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.245250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.245395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.245539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.245701 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.245865 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.246027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.246180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.246387 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.246545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.246698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.246844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.247003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.247195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.247353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.247507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.247652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.247805 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.247967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.248113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.248258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.248411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.248557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.248714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.248860 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.249021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.249176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.249330 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 25 03:34:55.249577 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.249757 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.250254 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.250403 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.250557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.250704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.250850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.251012 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.251245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.251432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.251610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.251862 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.252015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.252169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.252325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.252566 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.252747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.252747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.253149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.253297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.253297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.253595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.253755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.253755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.254030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.254185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.254331 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.254483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.254483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.254786 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.254940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.255179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.255342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.255495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.255648 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.255817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.255971 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.256128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.256282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.256435 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.256582 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.256734 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.256881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257039 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.257953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.258245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.258391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.258537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.258701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.258701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.258979 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.259154 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.259305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.259457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.259714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.259903 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.260395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.260559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.260713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.260858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.261016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.261171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.261401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.261558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.261705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.262128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.262384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.262577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.262806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.262806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.263230 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.263404 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.263560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.263716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.263862 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.264006 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.264161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.264317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.264472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.264619 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.264775 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.264920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.265065 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.265225 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.265372 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.265517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.265661 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.265825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.266051 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.266051 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.266337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.266490 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.266636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.266798 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.266958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.267140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.267295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.267447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.267592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.267743 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.267902 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.268047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.268191 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.268337 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.268489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.268634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.268804 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.268958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.269104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.269266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.269414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.269573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.269737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.269962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.270130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.270600 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.270757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.270912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.271116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.271297 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.271542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.271696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.271852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.271852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.272139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.272139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.272508 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.272672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.272837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.272837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.273206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.273368 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.273541 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.273788 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.273953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.274107 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.274260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.274407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.274559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.274714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.274870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.275026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.275208 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.275365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.275529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.275681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.275836 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.275990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.276136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.276354 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.276504 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.276658 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.276815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.276969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.277122 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.277275 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.277428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.278125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.278287 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.278445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.278591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.278736 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.278890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.279185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.279376 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.279529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.279675 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.279829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.280002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.280247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.280780 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.280939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.281968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.282249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.282410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.282410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.282812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.282961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.283218 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.283391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.283540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.283727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.283727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.284318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.284475 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.284637 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.284784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.284928 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.285085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.285230 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.285375 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.285599 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.285776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.285931 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.286085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.286233 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.286379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.286538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.286538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.286815 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.286968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.287204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.287385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.287385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.287664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.287809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.287963 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288689 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288689 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.288980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.289315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.289470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.289638 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.289800 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.289962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.290125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.290390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.290809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.291157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.291322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.291477 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.291661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.291816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.291969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.292121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.292282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.292446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.292608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.292864 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.293024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.293879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.294053 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.294244 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.294507 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.294678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.294832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.295075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.295251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.295416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.295589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.295743 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.295903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.296064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.296228 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.296396 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.296558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.296712 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.296880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.297042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.297205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.297358 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.297518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.297679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.297834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.297995 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.298159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.298320 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.298481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.298642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.298805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.298968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.299229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.299391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.299391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.299687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.299687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.299990 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.300153 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.300306 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.300571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.300973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.301510 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.301693 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.301869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.302024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.302177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.302340 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.302503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.302671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.302852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.303104 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.303267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.303420 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.303584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.303760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.304024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.304184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.304345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.304524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.304788 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.304965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.305128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.305289 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.305443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.305601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.305767 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.305922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.306075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.306250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.306250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.306542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.306708 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.306862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.307020 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.307257 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.307462 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.307625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.307793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.307959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.308123 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.308304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.308566 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.308755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.308925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.309089 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.309254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.309254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.309544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.309705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.309867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.309867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.310479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.310749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.311198 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.311387 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.311666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.311826 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.311979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.312132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.312132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.312437 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.312591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.312591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.312879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.313960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.314521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.314676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.314953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.315177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.315346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.315510 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.315671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.315847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.316001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.316167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.316321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.316474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.316627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.316627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.316924 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.317086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.317086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.317384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.317384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.317684 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.317863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.318026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.318188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.318341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.318341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.318638 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.318638 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.318944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.319127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.319288 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.319449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.319602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.319781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.319935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.320086 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.320237 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.320390 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.320557 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.320738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.320990 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.321381 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.321543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.321727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.322000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.322160 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.322324 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.322484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.322638 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.322790 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.322952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.323187 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.323446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.323654 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.323813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.323969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.324130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.324442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.324615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.324787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.324970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.325241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.325417 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.325583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.325744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.325912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.326067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.326227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.326379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.326538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.326538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.326890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.327075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.327247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.327409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.327574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.327735 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.327903 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.328322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.328481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.328640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.328800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.328967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.329121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.329275 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.329437 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.329589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.329829 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.330060 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.330225 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.330387 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.330547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.330796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.331010 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.331569 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.331734 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.331896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.332182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.332345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.332531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.332782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.332949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.332949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.333251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.333436 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.333685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.333844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.333997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.334159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.334320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.334601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.334771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.334933 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.335106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.335475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.335789 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.335955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.336119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.336282 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.336436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.336603 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.336758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.336758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.337086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.337249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.337409 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.337571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.337571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.337571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.338032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.338193 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.338347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.338499 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.338499 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.338803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.338956 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.339162 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.339323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.339476 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.339637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.339801 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.340488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.340652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.340806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.340966 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.341165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.341719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.341894 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.342061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.342241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.342497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.342667 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.342828 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.342988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.343168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.343168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.343469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.343649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.343649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.344028 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.344180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.344356 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.344517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.344771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.344934 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.345095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.345254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.345426 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.345687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.345867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.346023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.346183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.346336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.346489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.346668 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.346831 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.346986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.347220 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.347374 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.347535 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.347698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.347863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.348031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.348193 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.348354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.348509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.348670 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.348834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.348994 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.349148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.349300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.349300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.349604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.349758 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.349917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.350081 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.350234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.350399 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.350552 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.350703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.350874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.351036 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.351224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.351224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.351883 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.352806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.353298 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.353470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.353641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.353796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.354061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.354231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.354398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.354559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.354749 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.355001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.355206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.355374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.355535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.356997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.359348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.360631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.360631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.360945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.361110 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.361110 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.361425 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.361579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.362421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.362591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.362765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.363043 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.363240 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.363397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.363562 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.363724 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.363879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.364067 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.364332 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.364502 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.364656 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.364811 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.364981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.365240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.365413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.365576 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.365731 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.365908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.366069 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.366232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.366385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.366557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.366850 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.367012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.367215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.367455 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.367613 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.367613 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.367902 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.368067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.368227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.368227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.368531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.368684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.368836 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.369001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.369154 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.369321 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.369474 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.369626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.369778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.369778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.370099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.370267 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.370422 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.370575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.370575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.370863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.371024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.371508 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.371681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.371681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.372196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.373832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.375249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.375249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.375638 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.375804 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.375804 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.376094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.376255 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.376416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.376586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.376756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.376910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.377093 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.377359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.377522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.377676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.377848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.378003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.378155 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.378306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.378466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.378628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.378782 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.378939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.379110 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.379281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.379445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.379610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.379764 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.379924 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.380077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.380228 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.380387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.380551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.380551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.380858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.381012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.381174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.381174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.381174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.381639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.381800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.381975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.382223 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.382383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.382787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.382959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.383186 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.383460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.383631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.383794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.383968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.384123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.384275 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.384429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.384608 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.384848 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.385014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.385168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.385329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.385516 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.385745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.385907 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.386068 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.386235 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.386396 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.386566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.386566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.387375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.387651 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.387879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.388046 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.388212 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.388366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.388527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.388681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.388844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.389931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.390223 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.390223 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.390521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.390521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.390828 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.391002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.391180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.391346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.391498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.391651 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.391886 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.392044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.392044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.392458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.392647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.392647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.393226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.393394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.393394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.393831 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.393994 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.394163 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.394325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.394478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.394631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.394791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.395100 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.395283 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.395439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.395591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.395780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.396025 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.396025 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.396338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.396500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.396654 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.396813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.396813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.397102 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.397264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.397264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.397563 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.397833 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398614 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.398932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.399270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.399433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.399433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.399742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.399915 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.399915 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.400221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.400373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.400534 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.400688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.400688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.400987 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.405353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.405353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.405710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.405872 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.405872 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.406257 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.406434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.406590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.406747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.406747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.407104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.407278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.407278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.407583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.407743 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.407920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.408085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.408085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.408584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.408739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.408739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.409103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.409271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.409271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.409575 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.409729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.409729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.410996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.411636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.411807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.411807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.412109 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.412262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.412262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.412581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.412746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.412746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413200 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413355 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413824 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.413987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.414278 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.414450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.414450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.414810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.414973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.415224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.415543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.415543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.415543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416938 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.416938 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.417236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.417416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.417584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.417739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.417739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.418040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.418799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.418799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.419291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.419468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.419468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.419799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.419954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.419954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.419954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.420409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.420564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.420564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.420853 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.421021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.421021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.421419 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.421585 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.421749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.421929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.421929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.422233 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.422387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.422387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.422716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.422947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.422947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.423300 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.423457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.423457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.423817 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.423984 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.423984 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.424293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.424447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.424447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.424760 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.424921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.425084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.425239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.425239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.425239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.425922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.426079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.426079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.426369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.426522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.426522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.426865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.427031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.427031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.427031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.427511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.427689 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.427689 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.427993 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.428147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.428299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.428465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.428465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.428769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.428769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.429290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.429462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.429624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.429790 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.429790 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.430093 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.430247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.430247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.430631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.430796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.430796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.431107 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.431279 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.431434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.431602 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.431773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.431949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.432111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.432273 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.432273 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.432587 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.432741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.432741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.432741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.433192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.433412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.433578 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.433983 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.433983 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.434354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.434518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.434687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.434843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.434843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.435186 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.435350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.435512 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.435697 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.436031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.436242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.436415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.436581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.436754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.436918 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.437072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.437227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.437388 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.437549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.437718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.437881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.438043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.438198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.438198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.438496 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.438731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.438898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.439071 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.439347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.439602 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.439762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.439931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.440086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.440248 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.440404 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.440558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.440710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.440872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.441037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.441037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.441328 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.441489 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.441642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.441642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.441965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.442127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.442288 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.442443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.442610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.442610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.442910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.443100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.443262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.443430 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.443600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.443754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.443908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.444060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.444214 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.444367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.444531 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.444692 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.444852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.445014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.445014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.445340 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.445508 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.445508 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.445801 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.445972 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.446435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.446611 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.446767 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.446921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.447159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.447323 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.447490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.447667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.447822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.447974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.448134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.448295 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.448450 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.448622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.448778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.448930 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.449083 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.449243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.449525 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.449822 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.449985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.450140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.450294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.450446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.450446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.450754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.450908 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.451087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.451248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.451413 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.451580 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.451742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.451921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.452084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.452248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.452410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.452583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.452739 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.452893 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.453305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.453305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.453609 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.453764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.453926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.454099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.454256 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.454410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.454577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.454732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.454885 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.454885 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.455251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.455407 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.455576 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.455738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.455902 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.456064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.456425 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.456598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.456764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.456918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.457074 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.457234 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.457396 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.457560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.457716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.457870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.458040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.458204 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.458377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.458540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.458540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.458841 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.458994 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.459186 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.459357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.459530 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.459760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.460027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.460195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.460360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.460540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.460702 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.460866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.461080 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.461238 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.461393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.461560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.461714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.461884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.462040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.462193 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.462362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.462516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.462687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.462842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.462995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.463195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.463367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.463521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.463675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.463675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.463965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.464118 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.464289 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.464453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.464608 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.464772 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.464932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.465633 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.465801 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.465956 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.466108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.466260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.466260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.466775 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.466931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.467164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.467364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.467548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.467713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.467878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.468035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.468188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.468341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.468494 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.468648 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.468648 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.468961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.469124 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.469279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.469458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.469628 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.469813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.470064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.470064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.470536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.470702 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.470935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.470935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.471300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.471300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.471595 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.471756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.471756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.472086 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.472248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.472511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.472673 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.472840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.472994 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.473156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.473310 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.473464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.473625 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.473805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.473973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.474135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.474289 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.474442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.474603 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.474772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.474926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.475108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.475270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.475424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.475588 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.475753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.475908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.476075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.476239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.476393 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.476757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.476925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.477081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.477234 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.477395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 03:34:55.477550 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.477714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.477967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.478301 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.478636 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.478962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.479317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.479736 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.479987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.480314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.481209 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.481567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.481901 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.482232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.482572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.483042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.483412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.483760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.484125 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.484454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.484815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.485154 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.485480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.485804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.486121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 25 03:34:55.486375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 25 03:34:55.505610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_db.sqlalchemy.engines [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:55.511418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:55.573467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.context [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cb78da0-bb01-419a-a509-9b31671d00b0(cell1) {{(pid=123362) load_cells /opt/stack/nova/nova/context.py:464}} Jan 25 03:34:55.579692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:34:55.581263 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:34:55.582127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:34:55.583718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.context [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8cb78da0-bb01-419a-a509-9b31671d00b0(cell1) {{(pid=123363) load_cells /opt/stack/nova/nova/context.py:464}} Jan 25 03:34:55.584158 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:34:55.588072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:34:55.589674 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:34:55.591595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:34:55.593551 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:34:55.595862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_db.sqlalchemy.engines [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:55.599793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_db.sqlalchemy.engines [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:55.607322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:55.608918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:55.774540 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_db.sqlalchemy.engines [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:55.785644 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 25 03:34:56.120492 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: WARNING keystonemiddleware.auth_token [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:34:56.127666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: WARNING keystonemiddleware.auth_token [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:34:56.213587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: WARNING keystonemiddleware.auth_token [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:34:56.221700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: WARNING keystonemiddleware.auth_token [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:34:56.480052 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: WARNING keystonemiddleware.auth_token [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:34:56.485306 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: WARNING keystonemiddleware.auth_token [None req-9cb71e5f-7313-48cf-9b43-69d0375198bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:34:56.490642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55bfc49de9c0 pid: 123363 (default app) Jan 25 03:34:56.592856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: WARNING keystonemiddleware.auth_token [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 25 03:34:56.598238 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: WARNING keystonemiddleware.auth_token [None req-f83ab122-c18c-43da-a779-5cd1294c897c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 25 03:34:56.603431 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55bfc49de9c0 pid: 123362 (default app) Jan 25 03:35:30.527209 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-186389c7-11aa-435c-8a96-9608d9356c91 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Action: 'create', calling method: .version_select at 0x7f33aa3f89d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-428627589", "metadata": {"Type": "work"}}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:30.528904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-186389c7-11aa-435c-8a96-9608d9356c91 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:30.529922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-186389c7-11aa-435c-8a96-9608d9356c91 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.022933 Jan 25 03:35:30.531227 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 1/1] 10.222.0.115 () {60 vars in 1160 bytes} [Tue Jan 25 03:35:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1026 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:35:30.542524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f9ab20bb-dd96-4dd3-9c6f-09c5935496f4 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Action: 'create', calling method: .version_select at 0x7f33aa3c3550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1479104505", "metadata": {"Type": "work"}}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:30.549157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f9ab20bb-dd96-4dd3-9c6f-09c5935496f4 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:30.550033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f9ab20bb-dd96-4dd3-9c6f-09c5935496f4 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011264 Jan 25 03:35:30.550602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 2/2] 10.222.0.115 () {60 vars in 1160 bytes} [Tue Jan 25 03:35:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:35:30.560682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-35153270-8b6d-4b62-bcb4-79a7defb510c tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Action: 'create', calling method: .version_select at 0x7f33aa3f89d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-514895052", "metadata": {"Type": "work"}}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:30.562134 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-35153270-8b6d-4b62-bcb4-79a7defb510c tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:30.563007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-35153270-8b6d-4b62-bcb4-79a7defb510c tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006894 Jan 25 03:35:30.563944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 3/3] 10.222.0.115 () {60 vars in 1160 bytes} [Tue Jan 25 03:35:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:35:30.585073 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7e0282d3-bebe-40e7-bdf1-be8b72771e81 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Calling method '.version_select at 0x7f33aa379040>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:30.672213 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3c723725-0276-4f39-9468-8ba4e0d93142 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Action: 'create', calling method: .version_select at 0x7f33aa3f89d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1421303537"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:30.934427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-7e0282d3-bebe-40e7-bdf1-be8b72771e81 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] HTTP exception thrown: Volume tempest-invalid-1305627697 could not be found. Jan 25 03:35:30.935327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7e0282d3-bebe-40e7-bdf1-be8b72771e81 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Returning 404 to user: Volume tempest-invalid-1305627697 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:30.936744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7e0282d3-bebe-40e7-bdf1-be8b72771e81 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1305627697" status: 404 len: 99 microversion: 2.1 time: 0.368090 Jan 25 03:35:30.938258 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 4/4] 10.222.0.115 () {58 vars in 1222 bytes} [Tue Jan 25 03:35:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1305627697 => generated 99 bytes in 370 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 25 03:35:30.953979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f2ecfc62-dd79-464d-8a8e-683e26b18216 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005063 Jan 25 03:35:30.956163 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 5/5] 10.222.0.115 () {58 vars in 1144 bytes} [Tue Jan 25 03:35:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 25 03:35:30.967582 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-297bf11a-249a-4982-a9b4-d3d9ffac9a57 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006388 Jan 25 03:35:30.969514 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 6/6] 10.222.0.115 () {58 vars in 1141 bytes} [Tue Jan 25 03:35:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 25 03:35:30.993385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e64a2e77-8fee-42f5-98ba-3c3908b59fb0 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Calling method '.version_select at 0x7f33aa3c3ee0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:31.926411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-e64a2e77-8fee-42f5-98ba-3c3908b59fb0 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] HTTP exception thrown: Volume ac44980a-0796-4217-8681-c9c597d11575 could not be found. Jan 25 03:35:31.927011 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e64a2e77-8fee-42f5-98ba-3c3908b59fb0 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Returning 404 to user: Volume ac44980a-0796-4217-8681-c9c597d11575 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:31.927885 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e64a2e77-8fee-42f5-98ba-3c3908b59fb0 tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/ac44980a-0796-4217-8681-c9c597d11575" status: 404 len: 109 microversion: 2.1 time: 0.941938 Jan 25 03:35:31.933055 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 7/7] 10.222.0.115 () {58 vars in 1252 bytes} [Tue Jan 25 03:35:30 2022] DELETE /compute/v2.1/os-volumes/ac44980a-0796-4217-8681-c9c597d11575 => generated 109 bytes in 943 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:31.938363 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c53b4ab5-8bd4-4128-ab25-7c18fec91eed tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Calling method '.version_select at 0x7f33aa25e1f0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:32.058525 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-c53b4ab5-8bd4-4128-ab25-7c18fec91eed tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] HTTP exception thrown: Volume e68b205f-bd74-4076-b468-fe7fa1197f1b could not be found. Jan 25 03:35:32.059650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c53b4ab5-8bd4-4128-ab25-7c18fec91eed tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] Returning 404 to user: Volume e68b205f-bd74-4076-b468-fe7fa1197f1b could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:32.068101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c53b4ab5-8bd4-4128-ab25-7c18fec91eed tempest-VolumesNegativeTest-554698534 tempest-VolumesNegativeTest-554698534-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/e68b205f-bd74-4076-b468-fe7fa1197f1b" status: 404 len: 109 microversion: 2.1 time: 0.126386 Jan 25 03:35:32.069655 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 8/8] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:31 2022] GET /compute/v2.1/os-volumes/e68b205f-bd74-4076-b468-fe7fa1197f1b => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:32.137171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3c723725-0276-4f39-9468-8ba4e0d93142 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.467401 Jan 25 03:35:32.137945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 1/9] 10.222.0.115 () {60 vars in 1159 bytes} [Tue Jan 25 03:35:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2470 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 25 03:35:32.150178 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6aaefebe-7d65-4f2a-a3c9-5f7a3ada3564 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33aa2d15e0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:32.209660 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6aaefebe-7d65-4f2a-a3c9-5f7a3ada3564 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13" status: 200 len: 345 microversion: 2.1 time: 0.062754 Jan 25 03:35:32.211165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 9/10] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:32 2022] GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:32.594827 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1992890849", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "deac9f35-58f2-4929-9ca8-e3d4d0912a3d"}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:32.645325 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1731902935", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "835e181b-635d-41dd-9269-42b6c17d0334"}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:32.804011 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] validate_networks() for [('deac9f35-58f2-4929-9ca8-e3d4d0912a3d', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:35:32.858721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] validate_networks() for [('835e181b-635d-41dd-9269-42b6c17d0334', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:35:33.938944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:35:33.938944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:35:33.938944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:35:33.938944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:35:33.938944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:35:33.953847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:33.954507 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:33.955513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:33.956125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:34.000142 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Getting quotas for project 33b8fc6cf53240e292dae12d36286f56. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:35:34.008254 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Getting quotas for user 420b2ab1a77943a59c942d3837545fa3 and project 33b8fc6cf53240e292dae12d36286f56. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:35:34.020358 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:35:34.023712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:35:34.176547 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a959a30e-5a9e-457c-89d2-b1c835a5756b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.704682 Jan 25 03:35:34.183725 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 2/11] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:35:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:35:34.189364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ce2dd6b5-9aee-4d8f-a4e2-ae49f05db97c tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a995d1f0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:34.406595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:35:34.407153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:35:34.407268 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ce2dd6b5-9aee-4d8f-a4e2-ae49f05db97c tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/10ff9564-4ea8-444a-a117-1a8ab85f303d" status: 200 len: 350 microversion: 2.1 time: 0.222002 Jan 25 03:35:34.407503 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:35:34.407908 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:35:34.413792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 3/12] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:34 2022] GET /compute/v2.1/os-volumes/10ff9564-4ea8-444a-a117-1a8ab85f303d => generated 350 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:34.413792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e84a94a1-9af7-403f-aab9-38f8ddff14ec tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a995ddc0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:34.415022 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:35:34.444245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:34.444877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:34.449703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:34.450790 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:34.546870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e84a94a1-9af7-403f-aab9-38f8ddff14ec tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13" status: 200 len: 346 microversion: 2.1 time: 0.137470 Jan 25 03:35:34.547938 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 4/13] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:34 2022] GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13 => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:34.559655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-25766ad8-99f5-4794-9a84-cfefa1b53b51 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:34.562260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-25766ad8-99f5-4794-9a84-cfefa1b53b51 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:34.598430 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:35:34.622838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for user 66a4cd3a6bc441d8b1d4bfdd15a6402d and project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:35:34.666955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:35:34.674956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:35:34.758447 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-25766ad8-99f5-4794-9a84-cfefa1b53b51 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:34.813789 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-25766ad8-99f5-4794-9a84-cfefa1b53b51 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1219 microversion: 2.1 time: 0.264298 Jan 25 03:35:34.814436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 5/14] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:34 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1219 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:34.831794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-36d492d8-aefe-423d-86b5-70d914533ac0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Action: 'create', calling method: .version_select at 0x7f33a997cd30>, body: {"snapshot": {"volume_id": "5e261883-3c25-4fba-b6cd-f8afdfdbda13", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1287399837"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:35.002935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b19ae73d-a8e8-4017-9df6-910872fdc2a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.479087 Jan 25 03:35:35.006929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 10/15] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:35:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:35:35.024194 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-acea1082-9fec-49fa-8b23-673fd50d6ded tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:35.024820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-acea1082-9fec-49fa-8b23-673fd50d6ded tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:35.302823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-acea1082-9fec-49fa-8b23-673fd50d6ded tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:35.357348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-acea1082-9fec-49fa-8b23-673fd50d6ded tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1222 microversion: 2.1 time: 0.331223 Jan 25 03:35:35.371401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 11/16] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:35 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1222 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:35.885607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-36d492d8-aefe-423d-86b5-70d914533ac0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.979290 Jan 25 03:35:35.885607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 6/17] 10.222.0.115 () {60 vars in 1166 bytes} [Tue Jan 25 03:35:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:35.887711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8fff81fc-463c-4008-85d0-f6318c48742d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:35.887711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8fff81fc-463c-4008-85d0-f6318c48742d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:35.894509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4fd7e9fe-579a-4268-88ea-55ef462da2f7 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a995dd30>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:35.941026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4fd7e9fe-579a-4268-88ea-55ef462da2f7 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.050126 Jan 25 03:35:35.943460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 7/18] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:35 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:35.952935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3f63b750-b365-48b9-8287-7ddbe3cf525f tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a998bb80>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:36.000813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8fff81fc-463c-4008-85d0-f6318c48742d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:36.008146 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8fff81fc-463c-4008-85d0-f6318c48742d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1219 microversion: 2.1 time: 0.180584 Jan 25 03:35:36.012032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 12/19] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:35 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:36.032908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3f63b750-b365-48b9-8287-7ddbe3cf525f tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.083924 Jan 25 03:35:36.033623 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 8/20] 10.222.0.115 () {58 vars in 1144 bytes} [Tue Jan 25 03:35:35 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:35:36.045540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-eb8b6d78-fc23-4fce-bde4-ebe93280a507 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a9113b80>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:36.140478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-eb8b6d78-fc23-4fce-bde4-ebe93280a507 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.100271 Jan 25 03:35:36.141697 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 13/21] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:36 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:36.405839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-cfb3e665-3182-447e-ac11-3a8076bf334c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:36.406559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-cfb3e665-3182-447e-ac11-3a8076bf334c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:36.568428 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-cfb3e665-3182-447e-ac11-3a8076bf334c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:36.581266 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-cfb3e665-3182-447e-ac11-3a8076bf334c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1222 microversion: 2.1 time: 0.179316 Jan 25 03:35:36.581849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 9/22] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:36 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:37.030965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a958e682-f410-4d7e-8ca2-5a6ff7d6e999 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:37.031685 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a958e682-f410-4d7e-8ca2-5a6ff7d6e999 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:37.153564 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-94000ec4-5847-4c81-aa37-5d476f437bed tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a91148b0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:37.228148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-94000ec4-5847-4c81-aa37-5d476f437bed tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.070661 Jan 25 03:35:37.228148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 10/23] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:37 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:35:37.237438 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a958e682-f410-4d7e-8ca2-5a6ff7d6e999 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:37.245003 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a958e682-f410-4d7e-8ca2-5a6ff7d6e999 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1219 microversion: 2.1 time: 0.220181 Jan 25 03:35:37.248741 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 14/24] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:37 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:37.604111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:37.608093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:37.616749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:37.617771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:37.618710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:37.619332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:37.876974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7ced2e8a-4c0a-44ff-99e4-8f0a29d22ad5 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a9113430>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:37.876974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7ced2e8a-4c0a-44ff-99e4-8f0a29d22ad5 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/dc2464bd-8101-44d0-b75d-41c5fe8f5b4f" status: 200 len: 351 microversion: 2.1 time: 0.102228 Jan 25 03:35:37.876974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 15/25] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:37 2022] GET /compute/v2.1/os-volumes/dc2464bd-8101-44d0-b75d-41c5fe8f5b4f => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:35:37.901655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:37.928444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-85d3ca86-de00-4e41-bd50-cdc642c7c931 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1226 microversion: 2.1 time: 0.333336 Jan 25 03:35:37.930008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 11/26] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:37 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1226 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:38.234932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f41490e6-5d77-4f68-a462-907085312792 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a997f8b0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:38.264807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:38.265420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:38.297478 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:38.298061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f41490e6-5d77-4f68-a462-907085312792 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.070071 Jan 25 03:35:38.298368 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:38.298637 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 16/27] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:38 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:38.299576 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:38.300149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:38.511932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:38.519617 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b0e44d1f-ad30-4ed6-b01b-fb902537ce60 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1223 microversion: 2.1 time: 0.258389 Jan 25 03:35:38.524962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 12/28] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:38 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1223 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:38.947489 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:38.948413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:38.974172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:38.974894 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:38.978387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:38.979868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:39.310411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e62dd87f-fe43-417c-b9f3-faf1098a0dea tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a90bc550>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:39.361541 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:39.372664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e62dd87f-fe43-417c-b9f3-faf1098a0dea tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.066441 Jan 25 03:35:39.377450 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 13/29] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:39 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:35:39.381676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3327aadd-1d5a-4e9c-b137-44d0a95e4b11 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1226 microversion: 2.1 time: 0.438185 Jan 25 03:35:39.384140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 17/30] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:38 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1226 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:39.542065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:39.542978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:39.549831 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:39.550477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:39.551495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:39.552185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:39.764309 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:39.772056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2b486145-ef7b-42e9-9b7b-462b47f9aa7c tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1223 microversion: 2.1 time: 0.234169 Jan 25 03:35:39.772890 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 14/31] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:39 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1223 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:40.301516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1947428130", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:40.386171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-93d59fe9-3670-489f-8256-16e6b575fbbd tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a997cf70>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:40.395010 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] validate_networks() for [('21305d52-419e-4a5b-aa5c-f29427395669', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:35:40.433375 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-93d59fe9-3670-489f-8256-16e6b575fbbd tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.052455 Jan 25 03:35:40.438528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 15/32] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:40 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:40.446757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:40.448435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:40.461156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:40.461606 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:40.462532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:40.464002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:40.554237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:40.566874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1a52f55d-5410-4a1c-8870-b4a12806093e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1226 microversion: 2.1 time: 0.123323 Jan 25 03:35:40.574413 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 16/33] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:40 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1226 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:40.984044 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:35:40.988605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:35:40.989452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:35:40.990087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:35:40.990690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:35:41.000795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:41.001306 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:41.002126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:41.002565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:41.032949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Getting quotas for project b7c304fa11cb41daba65e6a85cf2c360. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:35:41.047270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2326314f-0882-4cba-ae72-b2339b4e86e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'create', calling method: .version_select at 0x7f33a911a1f0>, body: {"keypair": {"name": "tempest-keypair-1803624160"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:41.053589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Getting quotas for user e068edc490c245eba236e3e13f40982f and project b7c304fa11cb41daba65e6a85cf2c360. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:35:41.067687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:35:41.070269 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:35:41.076606 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-2326314f-0882-4cba-ae72-b2339b4e86e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:35:41.081598 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-2326314f-0882-4cba-ae72-b2339b4e86e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for user 8f0cd1ec82a347f2babd996424cbb0b2 and project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:35:41.204646 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b66ad16a-1d64-4b12-8607-2eb4287f75f9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.138798 Jan 25 03:35:41.205297 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 18/34] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:35:40 2022] POST /compute/v2.1/servers => generated 385 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:35:41.209826 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:41.210732 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:41.220348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:41.220807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:41.221654 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:41.222091 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:41.309416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:41.317587 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8b40bb8f-569a-4b51-9b44-711ec9080036 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1223 microversion: 2.1 time: 0.110568 Jan 25 03:35:41.322700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 19/35] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:41 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:41.323200 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-01ec9f7d-4315-43af-9eaa-b3cd1a8811aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:41.323647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-01ec9f7d-4315-43af-9eaa-b3cd1a8811aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:41.397049 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-2326314f-0882-4cba-ae72-b2339b4e86e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:35:41.408888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-2326314f-0882-4cba-ae72-b2339b4e86e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for user 8f0cd1ec82a347f2babd996424cbb0b2 and project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:35:41.441842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2326314f-0882-4cba-ae72-b2339b4e86e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.671738 Jan 25 03:35:41.447927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 17/36] 10.222.0.115 () {62 vars in 1203 bytes} [Tue Jan 25 03:35:40 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 678 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 25 03:35:41.454705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a56de051-31bc-4313-ae0b-60babf62a0d4 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a9097670>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:41.464508 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-01ec9f7d-4315-43af-9eaa-b3cd1a8811aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:41.475435 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-01ec9f7d-4315-43af-9eaa-b3cd1a8811aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1226 microversion: 2.1 time: 0.156337 Jan 25 03:35:41.488192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 20/37] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:41 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1226 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:41.490029 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a56de051-31bc-4313-ae0b-60babf62a0d4 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.040087 Jan 25 03:35:41.494964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 18/38] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:41 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:41.582229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:41.582848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:41.598571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:41.598571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:41.598571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:41.598571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:41.601685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1996226176", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:41.672600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] validate_networks() for [('21305d52-419e-4a5b-aa5c-f29427395669', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:35:41.685727 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:41.695185 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e255981b-9051-4c68-9e5e-5b5940eda950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1226 microversion: 2.1 time: 0.116181 Jan 25 03:35:41.700811 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 21/39] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:41 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:42.230482 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:35:42.230899 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:35:42.231759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:35:42.238583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:35:42.238583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:35:42.243353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:42.243806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:42.245281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:42.245720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:42.264050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Getting quotas for project b7c304fa11cb41daba65e6a85cf2c360. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:35:42.268945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Getting quotas for user e068edc490c245eba236e3e13f40982f and project b7c304fa11cb41daba65e6a85cf2c360. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:35:42.284413 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:35:42.286854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:35:42.345315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:42.346002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:42.357767 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:42.358432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:42.361927 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:42.362558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:42.473926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:42.502135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-68c7754b-fabf-4110-b110-1139f1432cbb tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 0.901981 Jan 25 03:35:42.507225 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 19/40] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:35:41 2022] POST /compute/v2.1/servers => generated 385 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 25 03:35:42.514904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fa0acd2a-c976-468b-a13d-150f5b51e927 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1223 microversion: 2.1 time: 0.176955 Jan 25 03:35:42.515571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 22/41] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:42 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1223 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:42.524855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-af7271af-d3dd-440a-90f6-862def7d41c6 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a9097550>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:42.526505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4234a700-245e-44c5-b9c3-991003d52e1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:42.529032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4234a700-245e-44c5-b9c3-991003d52e1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:42.622935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-af7271af-d3dd-440a-90f6-862def7d41c6 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.114208 Jan 25 03:35:42.624868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 20/42] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:42 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:42.625576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4234a700-245e-44c5-b9c3-991003d52e1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:42.633960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4234a700-245e-44c5-b9c3-991003d52e1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1226 microversion: 2.1 time: 0.117302 Jan 25 03:35:42.636022 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 23/43] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:42 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:42.717877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:42.718701 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:42.737749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:42.738327 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:42.746542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:42.748352 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:42.911144 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:42.933519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c85aa060-d65d-4d37-b482-2ab9c2143094 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1226 microversion: 2.1 time: 0.219359 Jan 25 03:35:42.936059 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 21/44] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:42 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1226 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:43.534771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:43.537771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:43.554248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:43.558034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:43.558815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:43.560074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:43.638204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-371cf291-54f5-4df3-99f8-323033fa9a1e tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a9056940>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:43.672147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:43.680499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e62595b8-8dc8-4885-bb04-eb116c61f5ed tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1215 microversion: 2.1 time: 0.150131 Jan 25 03:35:43.682901 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 24/45] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:43 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:43.693733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b2b658ae-6c98-4d22-bc47-9f08abf7147c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:43.695365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b2b658ae-6c98-4d22-bc47-9f08abf7147c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:43.856863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b2b658ae-6c98-4d22-bc47-9f08abf7147c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:43.873100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b2b658ae-6c98-4d22-bc47-9f08abf7147c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1226 microversion: 2.1 time: 0.188743 Jan 25 03:35:43.873787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 25/46] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:43 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1226 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:43.884496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-371cf291-54f5-4df3-99f8-323033fa9a1e tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 288 microversion: 2.1 time: 0.245672 Jan 25 03:35:43.884496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 22/47] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:43 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 288 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:35:43.890643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1d4a6521-51dd-463d-96f3-1511cd788753 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a9069700>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:43.955859 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:43.956479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:43.970739 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:43.971357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:43.972371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:43.973017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:44.048858 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:44.058841 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7268a1e7-b9ef-4809-8158-d1f4e8a777e3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1218 microversion: 2.1 time: 0.109075 Jan 25 03:35:44.061561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 23/48] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:43 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:44.715873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:44.715873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:44.716789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1d4a6521-51dd-463d-96f3-1511cd788753 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "DELETE /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 202 len: 0 microversion: 2.1 time: 0.823907 Jan 25 03:35:44.716789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 26/49] 10.222.0.115 () {58 vars in 1258 bytes} [Tue Jan 25 03:35:43 2022] DELETE /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:35:44.724717 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cf349baa-dcee-4c6a-9b66-1d9dae9bd1fc tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a9069820>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:44.727523 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:44.728170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:44.730301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:44.732305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:44.883093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:44.893042 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5087d171-71f1-4d3f-8780-3419d0b3bcea tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1215 microversion: 2.1 time: 0.192649 Jan 25 03:35:44.895263 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 24/50] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:44 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:44.903147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a0fb5d58-081b-4355-b07a-9aff71d77019 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a88290d0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:44.983428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cf349baa-dcee-4c6a-9b66-1d9dae9bd1fc tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 200 len: 287 microversion: 2.1 time: 0.266163 Jan 25 03:35:44.983993 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 27/51] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:44 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 287 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:44.992707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:44.993495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:45.002709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:45.003785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:45.005066 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:45.005649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:45.026887 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a0fb5d58-081b-4355-b07a-9aff71d77019 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/dff185dd-b17c-4263-bdd3-a629dce931bd" status: 200 len: 350 microversion: 2.1 time: 0.129877 Jan 25 03:35:45.028081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 25/52] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:44 2022] GET /compute/v2.1/os-volumes/dff185dd-b17c-4263-bdd3-a629dce931bd => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:45.038746 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e4313290-724d-4e07-b221-fd3dfe91b737 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a90bf550>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.098627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:45.108313 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-69bedae3-b4a3-4aaf-bc4c-8e2196ee5ba1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1278 microversion: 2.1 time: 0.119201 Jan 25 03:35:45.113750 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 28/53] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:44 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1278 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:45.125772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.126702 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:45.130813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e4313290-724d-4e07-b221-fd3dfe91b737 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095573 Jan 25 03:35:45.140720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 26/54] 10.222.0.115 () {58 vars in 1138 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:45.148190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e3830a09-0458-449f-95f8-4403a7806973 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a9064940>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.148596 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:45.150251 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:45.151394 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:45.152550 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:45.312437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e3830a09-0458-449f-95f8-4403a7806973 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.168036 Jan 25 03:35:45.313201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 27/55] 10.222.0.115 () {58 vars in 1153 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:45.325065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f994b448-64b3-4513-84ad-a77f1694e6e3 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a90560d0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.423323 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:45.430949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d18fa8ea-73f6-4b6e-bc36-d21573a0a850 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1218 microversion: 2.1 time: 0.315746 Jan 25 03:35:45.436047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f994b448-64b3-4513-84ad-a77f1694e6e3 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.114633 Jan 25 03:35:45.436671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 28/56] 10.222.0.115 () {58 vars in 1138 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:45.443712 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 29/57] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1218 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:45.453161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-60a37189-ebb0-4118-ab7d-0fae9013505e tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a9092d30>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.575206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-60a37189-ebb0-4118-ab7d-0fae9013505e tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.130428 Jan 25 03:35:45.575787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 30/58] 10.222.0.115 () {58 vars in 1171 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:45.587873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-79704c4c-a1c1-42a2-8df6-218f5571f9b4 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a88294c0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.673365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-79704c4c-a1c1-42a2-8df6-218f5571f9b4 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089042 Jan 25 03:35:45.673968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 29/59] 10.222.0.115 () {58 vars in 1174 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:45.686320 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-db23b191-4bb0-4358-8c82-8a1c970e4c23 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a90c4dc0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.789857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-db23b191-4bb0-4358-8c82-8a1c970e4c23 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.106941 Jan 25 03:35:45.791294 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 31/60] 10.222.0.115 () {58 vars in 1159 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:45.801971 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a6754cb0-4a3b-45e9-bc74-f70bde0c082c tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a9064b80>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.886755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a6754cb0-4a3b-45e9-bc74-f70bde0c082c tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088375 Jan 25 03:35:45.889223 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 30/61] 10.222.0.115 () {58 vars in 1192 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:45.904243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-20d3daab-5afa-4f4a-9da1-748914bb8707 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] Calling method '.version_select at 0x7f33a908fa60>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.910695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:45.911431 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:45.919813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:45.920409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:45.921378 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:45.921946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:46.010326 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-20d3daab-5afa-4f4a-9da1-748914bb8707 tempest-VolumesTestJSON-1885934070 tempest-VolumesTestJSON-1885934070-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.109815 Jan 25 03:35:46.010902 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 32/62] 10.222.0.115 () {58 vars in 1159 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:46.015244 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-83ecd7be-9a10-4a31-84d9-b03fec3e155b tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a908f670>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:46.057700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:46.067841 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2bb2d7cb-5f83-4526-8831-c3cfc62be0cc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1271 microversion: 2.1 time: 0.160422 Jan 25 03:35:46.068804 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 31/63] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:45 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:46.085564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-83ecd7be-9a10-4a31-84d9-b03fec3e155b tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] HTTP exception thrown: Snapshot 573713a7-ec53-4b22-8f21-fb6d8dfdc63b could not be found. Jan 25 03:35:46.085564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-83ecd7be-9a10-4a31-84d9-b03fec3e155b tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Returning 404 to user: Snapshot 573713a7-ec53-4b22-8f21-fb6d8dfdc63b could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:46.085564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-83ecd7be-9a10-4a31-84d9-b03fec3e155b tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b" status: 404 len: 111 microversion: 2.1 time: 0.073689 Jan 25 03:35:46.090733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 33/64] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:35:46 2022] GET /compute/v2.1/os-snapshots/573713a7-ec53-4b22-8f21-fb6d8dfdc63b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:46.095726 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7845223a-d047-4fbe-b98f-32e99dbffdd6 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a9064dc0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:46.129784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:46.130464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:46.137907 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:46.138434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:46.140439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:46.140439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:46.271206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:46.291421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c1b44a6b-9993-4cf1-8b4c-169672abaed8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1296 microversion: 2.1 time: 0.165263 Jan 25 03:35:46.295848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 34/65] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:46 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1296 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:46.303380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-377497663", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f476d920-246d-45fc-9288-e583ed5f94c0"}], "security_groups": [{"name": "tempest-securitygroup--2079748481"}], "key_name": "tempest-keypair-1803624160", "user_data": "}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:46.614220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] validate_networks() for [('f476d920-246d-45fc-9288-e583ed5f94c0', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:35:46.719236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7845223a-d047-4fbe-b98f-32e99dbffdd6 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13" status: 202 len: 0 microversion: 2.1 time: 0.617946 Jan 25 03:35:46.719236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 32/66] 10.222.0.115 () {58 vars in 1252 bytes} [Tue Jan 25 03:35:46 2022] DELETE /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:35:46.719236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:46.719236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:46.733750 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:46.733870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:46.734562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:46.734998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:46.984206 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:46.995768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-20465028-5605-4b9e-8ade-17f77e46c143 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1274 microversion: 2.1 time: 0.283669 Jan 25 03:35:47.003845 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 33/67] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:46 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1274 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:47.019843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b17f8546-16cf-4cbb-a2a6-d2ec4cd40bf0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a90bf310>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:47.161454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b17f8546-16cf-4cbb-a2a6-d2ec4cd40bf0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13" status: 200 len: 345 microversion: 2.1 time: 0.149731 Jan 25 03:35:47.161454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 34/68] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:47 2022] GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13 => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:47.164407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:47.165019 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:47.180946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:47.182104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:47.183182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:47.187713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:47.346956 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:47.358763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-745d4760-3eed-4aaf-872e-efdc711e86b6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1277 microversion: 2.1 time: 0.201688 Jan 25 03:35:47.361607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 35/69] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:47 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:47.373823 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:47.374764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:47.388072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:47.388870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:47.389948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:47.390583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:47.544950 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:47.553988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ce2cb1c5-1ac3-45bd-96c4-60160622437b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1284 microversion: 2.1 time: 0.189101 Jan 25 03:35:47.557864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 36/70] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:47 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:48.034490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:48.034490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:48.034490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.034490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.035493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.035493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.386318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:48.398125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5d7e2920-d913-4aef-8b01-7eec29e5eb94 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.381649 Jan 25 03:35:48.403835 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 37/71] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:48 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:48.410769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-084c6b56-0b2e-40f1-99ad-370d440f9ea0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a884a820>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:48.540484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-084c6b56-0b2e-40f1-99ad-370d440f9ea0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] HTTP exception thrown: Volume 5e261883-3c25-4fba-b6cd-f8afdfdbda13 could not be found. Jan 25 03:35:48.541259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-084c6b56-0b2e-40f1-99ad-370d440f9ea0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Returning 404 to user: Volume 5e261883-3c25-4fba-b6cd-f8afdfdbda13 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:48.542348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-084c6b56-0b2e-40f1-99ad-370d440f9ea0 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13" status: 404 len: 109 microversion: 2.1 time: 0.137417 Jan 25 03:35:48.547254 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 38/72] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:48 2022] GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:48.563632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:48.570604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:48.603930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.604874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.606165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.606934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.635940 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:35:48.637226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:35:48.637895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:35:48.638501 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:35:48.639338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:35:48.658915 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.659929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.663240 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.665004 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.732529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for project 33c5e2c89460402987c96eb3c3340a68. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:35:48.737567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for user 8f0cd1ec82a347f2babd996424cbb0b2 and project 33c5e2c89460402987c96eb3c3340a68. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:35:48.758286 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:48.759034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:35:48.761726 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:35:48.768210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-760a85bf-83a4-4c97-a132-0d3af2146ffc tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1277 microversion: 2.1 time: 0.219496 Jan 25 03:35:48.768787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 39/73] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:48 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:48.777542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-05560c47-276c-48ec-ae35-10cccb33dc10 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a884aee0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:48.831813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-05560c47-276c-48ec-ae35-10cccb33dc10 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] HTTP exception thrown: Volume 5e261883-3c25-4fba-b6cd-f8afdfdbda13 could not be found. Jan 25 03:35:48.832628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-05560c47-276c-48ec-ae35-10cccb33dc10 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Returning 404 to user: Volume 5e261883-3c25-4fba-b6cd-f8afdfdbda13 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:48.833481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-05560c47-276c-48ec-ae35-10cccb33dc10 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13" status: 404 len: 109 microversion: 2.1 time: 0.063502 Jan 25 03:35:48.834043 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 40/74] 10.222.0.115 () {58 vars in 1252 bytes} [Tue Jan 25 03:35:48 2022] DELETE /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:48.842575 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:48.843375 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:48.850798 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.851353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.852205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:48.852866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:48.920167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:48.929966 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-20c5e600-1511-4163-b73d-83cf2cb63f1b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1284 microversion: 2.1 time: 0.094650 Jan 25 03:35:48.930956 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 41/75] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:48 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:48.936374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-80721855-3a74-414a-917b-eb1cdf724a19 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Calling method '.version_select at 0x7f33a884a550>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:48.964088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-80721855-3a74-414a-917b-eb1cdf724a19 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] HTTP exception thrown: Volume 5e261883-3c25-4fba-b6cd-f8afdfdbda13 could not be found. Jan 25 03:35:48.964649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-80721855-3a74-414a-917b-eb1cdf724a19 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] Returning 404 to user: Volume 5e261883-3c25-4fba-b6cd-f8afdfdbda13 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:48.965600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-80721855-3a74-414a-917b-eb1cdf724a19 tempest-VolumesSnapshotsTestJSON-955157582 tempest-VolumesSnapshotsTestJSON-955157582-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13" status: 404 len: 109 microversion: 2.1 time: 0.032727 Jan 25 03:35:48.966288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 42/76] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:48 2022] GET /compute/v2.1/os-volumes/5e261883-3c25-4fba-b6cd-f8afdfdbda13 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:49.249467 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-75d01e26-5813-4577-8070-72b5b26c6025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 2.952043 Jan 25 03:35:49.250123 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 35/77] 10.222.0.115 () {62 vars in 1192 bytes} [Tue Jan 25 03:35:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 25 03:35:49.261054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a08ccd27-78ab-4db6-95ee-f695f325de90 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:49.261865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a08ccd27-78ab-4db6-95ee-f695f325de90 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:49.335571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a08ccd27-78ab-4db6-95ee-f695f325de90 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:49.344532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a08ccd27-78ab-4db6-95ee-f695f325de90 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:49.346061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a08ccd27-78ab-4db6-95ee-f695f325de90 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:49.347846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a08ccd27-78ab-4db6-95ee-f695f325de90 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1285 microversion: 2.20 time: 0.091543 Jan 25 03:35:49.351161 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 43/78] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:49 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:49.417152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:49.419934 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:49.427661 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:49.433746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:49.437965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:49.451460 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:49.561680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:49.569550 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1e3d2ac4-d6cb-4f12-b696-44fee059f815 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.156768 Jan 25 03:35:49.570127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 36/79] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:49 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:49.860685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:49.860685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:49.860685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:49.860685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:49.861242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:49.861242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:49.948436 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:49.951334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:49.957837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:49.958043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:49.958450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:49.959327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:49.967320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c6eabece-e225-4099-ba19-65297fa7a9f1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.185746 Jan 25 03:35:49.968366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 44/80] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:49 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:49.969844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:50.194244 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:50.196999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-75318f14-17ff-4bf8-ba79-e411f75f62ef tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.253000 Jan 25 03:35:50.197581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 37/81] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:49 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:50.368495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8db5639f-34dc-40f3-b545-30cbf9cfac9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:50.369126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8db5639f-34dc-40f3-b545-30cbf9cfac9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:50.427396 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8db5639f-34dc-40f3-b545-30cbf9cfac9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:50.436239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8db5639f-34dc-40f3-b545-30cbf9cfac9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:50.437856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8db5639f-34dc-40f3-b545-30cbf9cfac9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:50.438963 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8db5639f-34dc-40f3-b545-30cbf9cfac9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1285 microversion: 2.20 time: 0.074250 Jan 25 03:35:50.439572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 45/82] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:50 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1285 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:50.590450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:50.590450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:50.598418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:50.598893 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:50.599730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:50.600359 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:50.697980 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:50.706991 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8cbff6f1-30c9-4b9b-b539-901546e7b9db tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.123193 Jan 25 03:35:50.707965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 38/83] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:50 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:50.985132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:50.986343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:50.992288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:50.992891 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:50.994361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:50.994967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:51.155507 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:51.157761 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a71bdcc9-7409-4ecd-a4d3-6b3fbab4c786 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.176555 Jan 25 03:35:51.158343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 46/84] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:50 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:51.213801 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:51.214497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:51.220618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:51.221070 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:51.221848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:51.222290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:51.384801 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:51.392630 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e83877c9-e31f-44c6-b040-60ace0dcb8c5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.182649 Jan 25 03:35:51.393206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 39/85] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:51 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:51.459561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:51.460807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:51.469366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:51.469961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:51.470963 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:51.471573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:51.553017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:51.561588 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:51.563194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:51.564335 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-95bbeffd-9822-4178-9ff9-2f43d7b0694b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1289 microversion: 2.20 time: 0.110042 Jan 25 03:35:51.564881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 47/86] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:51 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:35:51.725461 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:51.726079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:51.732713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:51.733519 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:51.734056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:51.734500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:51.793924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:51.801297 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-136d3562-9506-49c1-8b09-9e4174d274d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.079628 Jan 25 03:35:51.801868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 40/87] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:51 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:52.174935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:52.175620 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:52.182580 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.182978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.183781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.184220 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.325645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:52.333250 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5fdb9ddb-7d43-444b-9e93-47c1c340736b tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.162005 Jan 25 03:35:52.333854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 48/88] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:52 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:52.409822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:52.410717 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:52.418546 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.421257 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.422439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.422882 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.673993 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:52.673993 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4d62539f-581e-44e8-b7ae-54dd6773643a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.214259 Jan 25 03:35:52.673993 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 49/89] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:52 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:52.673993 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:52.675239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:52.675239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.675239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.675239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.675722 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.676493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8463b7bc-4c0a-4e54-beae-978389af9a3e tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Action: 'create', calling method: .version_select at 0x7f33a907e4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1189426850", "metadata": {"Type": "work"}}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:35:52.714004 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:52.723082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:52.724808 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:52.726142 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d12d439a-4ded-4692-9894-f24c0db481b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1289 microversion: 2.20 time: 0.104480 Jan 25 03:35:52.727173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 50/90] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:52 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:52.824884 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:52.826263 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:52.833178 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.833724 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.834704 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:52.835351 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:52.909799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:52.919002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-363e2d0d-4da9-4ef0-8a61-7e6f66d8f6ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.099893 Jan 25 03:35:52.930796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 51/91] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:52 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:53.354267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:53.354882 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:53.362444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:53.362901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:53.363727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:53.364361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:53.501061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:53.508245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-790a0ddc-1c35-4343-8567-a4d8ca844e16 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.158353 Jan 25 03:35:53.508814 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 52/92] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:53 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:53.687378 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:53.688836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:53.702358 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:53.703077 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:53.704092 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:53.704718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:53.924363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:53.924363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-980fe511-ea5f-4dc2-9e2c-ba28e5b63a41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.215107 Jan 25 03:35:53.924363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 53/93] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:53 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:53.924363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:53.924749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:53.924749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:53.924749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:53.924749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:53.925068 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:53.982774 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:53.991698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:53.993662 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:53.994768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5f75ead0-8ea3-4b41-b076-bd0bbaa45e8c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1289 microversion: 2.20 time: 0.097285 Jan 25 03:35:53.995514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 54/94] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:53 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:54.001550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:54.001550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:54.006787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:54.007429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:54.010146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:54.010736 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:54.096667 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:54.110554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-283f9acd-a1c5-4f48-b5b4-8c9b00c13e95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.110863 Jan 25 03:35:54.119237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 55/95] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:53 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:54.526420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:54.527513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:54.533889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:54.534676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:54.536925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:54.537590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:54.746636 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8463b7bc-4c0a-4e54-beae-978389af9a3e tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.385080 Jan 25 03:35:54.748373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 41/96] 10.222.0.115 () {60 vars in 1160 bytes} [Tue Jan 25 03:35:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2388 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 25 03:35:54.760839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:54.767256 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-25651360-cf89-43e4-8665-f86caccf45a9 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Calling method '.version_select at 0x7f33a90a01f0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:54.778041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3c37943b-40dd-4d43-9800-d85a9225ffa5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.252748 Jan 25 03:35:54.787210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 56/97] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:54 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:54.980924 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:54.981660 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:54.987912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.019695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.019695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.019695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.135763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:55.143393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2948e616-0e56-4fa2-a641-e5a9dd559492 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.200492 Jan 25 03:35:55.153387 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 57/98] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:54 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:55.168816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:55.168816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:55.168816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.168816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.169217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.169217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.244130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:55.252063 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:55.253590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:55.254969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-24c6a3ff-d795-4f10-9b19-335357ce35cf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1289 microversion: 2.20 time: 0.100314 Jan 25 03:35:55.255596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 58/99] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:55 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:55.274032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-25651360-cf89-43e4-8665-f86caccf45a9 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a" status: 200 len: 353 microversion: 2.1 time: 0.511629 Jan 25 03:35:55.279778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 42/100] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:54 2022] GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a => generated 353 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:55.279947 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:55.279947 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:55.298460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.298573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.300528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.304234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.422112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:55.431397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a15348f6-babc-42e1-9dbe-d138c75d7ac6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.174507 Jan 25 03:35:55.432986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 59/101] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:55 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:55.803453 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:55.804072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:55.812405 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.812940 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.813890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:55.814378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:55.991143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:56.030667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-150e21d0-4c65-49e9-8740-a2ca1b1beee0 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.201614 Jan 25 03:35:56.030667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 43/102] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:55 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:56.161559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:56.162639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:56.170323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:56.170780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:56.171661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:56.172103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:56.277152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:56.277152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:56.283912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:56.284771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:56.287127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:56.287594 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:56.337013 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:56.351991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-47278a85-ce06-4c87-b363-0579fa4e6181 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.189349 Jan 25 03:35:56.353535 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 60/103] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:56 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:56.375296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a762334c-6e5c-464c-b237-8be0bbb6c8a0 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Calling method '.version_select at 0x7f33a90bf310>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:56.406236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:56.415043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:56.418077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:56.419473 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0b6d28e3-f6c3-4bee-91c3-e227ccda9025 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1289 microversion: 2.20 time: 0.148767 Jan 25 03:35:56.426245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 44/104] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:56 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1289 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:56.450470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:56.451573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:56.462682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:56.463285 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:56.465694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:56.466051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a762334c-6e5c-464c-b237-8be0bbb6c8a0 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a" status: 200 len: 353 microversion: 2.1 time: 0.111144 Jan 25 03:35:56.466748 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 61/105] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:56 2022] GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:56.466920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:56.565908 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:56.577792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-286a02c0-900c-41cf-9533-31e2694b4d3c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.131722 Jan 25 03:35:56.578440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 45/106] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:56 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:57.067196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:57.068098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:57.119252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.119252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.119252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.119252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.356637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:57.364222 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bb7a21d1-2225-4589-b42d-34dd3879d430 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.300718 Jan 25 03:35:57.369966 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:57.370570 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:57.374270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 62/107] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:57 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:57.377524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.377971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.378755 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.379226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.438175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:57.438866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:57.445446 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.446008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.447018 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.447577 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.521496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:57.531274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:57.533280 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:57.534785 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1f4ecab3-14f8-4489-bcff-f8e11a4441b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1289 microversion: 2.20 time: 0.100958 Jan 25 03:35:57.535970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 63/108] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:57 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:35:57.537576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:57.541226 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-55f7549d-2a64-4584-aecd-b5cb3e7fa627 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Calling method '.version_select at 0x7f33aac29ee0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:57.548264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4593c362-738a-408f-9772-64a30efb9679 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.181501 Jan 25 03:35:57.548264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 46/109] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:57 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:57.600772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:57.601292 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:57.605209 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-55f7549d-2a64-4584-aecd-b5cb3e7fa627 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a" status: 200 len: 354 microversion: 2.1 time: 0.068030 Jan 25 03:35:57.606874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 64/110] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:57 2022] GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:57.614877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.615353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.616139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:57.616757 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:57.617139 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-15acfcc4-cf9d-4088-88fa-248eeac0a160 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Calling method '.version_select at 0x7f33a884a4c0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:57.681676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-15acfcc4-cf9d-4088-88fa-248eeac0a160 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a" status: 200 len: 354 microversion: 2.1 time: 0.067814 Jan 25 03:35:57.685601 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 65/111] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:57 2022] GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:57.702112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b7c3a164-08e0-4002-93ee-78477e7fcf30 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Calling method '.version_select at 0x7f33a8829f70>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:57.702299 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:57.710038 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8eed698c-5119-46ea-b9cb-e09fe3d619ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.117258 Jan 25 03:35:57.710700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 47/112] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:57 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:57.966196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b7c3a164-08e0-4002-93ee-78477e7fcf30 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "DELETE /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a" status: 202 len: 0 microversion: 2.1 time: 0.269670 Jan 25 03:35:57.966782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 66/113] 10.222.0.115 () {58 vars in 1252 bytes} [Tue Jan 25 03:35:57 2022] DELETE /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:35:57.974397 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e67bf5d0-e5c5-49ae-ab1a-55b2d11cc7d8 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Calling method '.version_select at 0x7f33a90a0310>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:58.020101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e67bf5d0-e5c5-49ae-ab1a-55b2d11cc7d8 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a" status: 200 len: 353 microversion: 2.1 time: 0.049125 Jan 25 03:35:58.020664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 48/114] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:57 2022] GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:35:58.384940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:58.385828 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:58.394035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.394035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.394400 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.398488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.530148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:58.538000 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0e66dc57-96ce-4b9c-b54d-629d0c1a46ad tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.159263 Jan 25 03:35:58.538733 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 67/115] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:58 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:35:58.553669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:58.554957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:58.567168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.571093 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.571867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:58.571979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.572061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:58.572138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.576359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.576812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.578270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.578696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.647547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:58.657479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:58.659286 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:58.660400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-575a67a2-ce13-4d6f-b879-9c7a8b5f1535 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1289 microversion: 2.20 time: 0.110673 Jan 25 03:35:58.661143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 49/116] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:58 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:58.726916 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:58.728078 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:58.733879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.734321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.735151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:58.735575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:58.749184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:58.757703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9e4ebf21-7394-4488-aec4-52e5ea79a3b3 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.196389 Jan 25 03:35:58.760078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 68/117] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:58 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:58.808553 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:58.817490 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6caf9abc-e7a5-4277-8a9d-00016c3409c5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1282 microversion: 2.1 time: 0.094079 Jan 25 03:35:58.818479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 50/118] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:58 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:35:59.032973 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b64c00a0-80b2-4f39-a7de-6587532042a7 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Calling method '.version_select at 0x7f33a90bff70>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:59.062509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-b64c00a0-80b2-4f39-a7de-6587532042a7 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] HTTP exception thrown: Volume 286f65c2-726b-41c0-a97f-cbc088335e0a could not be found. Jan 25 03:35:59.063361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b64c00a0-80b2-4f39-a7de-6587532042a7 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] Returning 404 to user: Volume 286f65c2-726b-41c0-a97f-cbc088335e0a could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:35:59.064498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b64c00a0-80b2-4f39-a7de-6587532042a7 tempest-VolumesGetTestJSON-450791792 tempest-VolumesGetTestJSON-450791792-project] 10.222.0.115 "GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a" status: 404 len: 109 microversion: 2.1 time: 0.035980 Jan 25 03:35:59.065349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 69/119] 10.222.0.115 () {58 vars in 1249 bytes} [Tue Jan 25 03:35:59 2022] GET /compute/v2.1/os-volumes/286f65c2-726b-41c0-a97f-cbc088335e0a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:35:59.555404 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:59.557344 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:59.566858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:59.567667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:59.569825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:59.570496 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:59.678697 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:59.679940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:59.690710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:59.691213 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:59.692851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:59.693459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:59.797892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:59.810584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:59.812577 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:35:59.814816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f57652ce-8242-41e5-b4ef-9ace2b4c1952 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1337 microversion: 2.20 time: 0.139361 Jan 25 03:35:59.815721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 70/120] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:35:59 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1337 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:35:59.831961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:35:59.833494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:35:59.844412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:59.853762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:35:59.853762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:35:59.853762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:00.224071 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:00.240050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-726a07d3-341c-4cd6-b33a-517b9d507dd2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.422479 Jan 25 03:36:00.242532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 71/121] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:59 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:00.250274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:00.251381 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:00.258575 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:00.262005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:00.263533 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:00.264228 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:00.347378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:00.376445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-10f26275-f6ef-47f5-b64f-1166eec55fb8 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.824894 Jan 25 03:36:00.387838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 51/122] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:35:59 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:00.833379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:00.833974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:00.851634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:00.854591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:00.857171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:00.858196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:00.951561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:00.961522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-832fb226-ea46-4327-884f-dbae5d5c1e2f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.715642 Jan 25 03:36:00.964727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 72/123] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:00 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:01.135521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-f6abf6de-685c-4a7d-a1d6-cb549beb3ed2 req-d9e901ed-1006-40ef-b903-6783783b9d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a", "tag": "7a3865a4-17c6-440a-8dd3-3ff9c0e019f2"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:01.137944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:01.137944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:01.149672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-f6abf6de-685c-4a7d-a1d6-cb549beb3ed2 req-d9e901ed-1006-40ef-b903-6783783b9d60 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.150336 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-f6abf6de-685c-4a7d-a1d6-cb549beb3ed2 req-d9e901ed-1006-40ef-b903-6783783b9d60 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.166870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:01.179259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-f6abf6de-685c-4a7d-a1d6-cb549beb3ed2 req-d9e901ed-1006-40ef-b903-6783783b9d60 service nova] Creating event network-changed:7a3865a4-17c6-440a-8dd3-3ff9c0e019f2 for instance 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a on hv-cinder-81901 Jan 25 03:36:01.180292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-f6abf6de-685c-4a7d-a1d6-cb549beb3ed2 req-d9e901ed-1006-40ef-b903-6783783b9d60 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 25 03:36:01.182423 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4b5e293a-05ff-44d6-9fe9-a07aa72782de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.183452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4b5e293a-05ff-44d6-9fe9-a07aa72782de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.183818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:01.184681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4b5e293a-05ff-44d6-9fe9-a07aa72782de None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.185370 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:01.185592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4b5e293a-05ff-44d6-9fe9-a07aa72782de None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.186665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5bfcf910-6953-4b8d-8230-449a9f208f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1345 microversion: 2.20 time: 0.356900 Jan 25 03:36:01.201950 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 52/124] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:00 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1345 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:01.203855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.compute.rpcapi [None req-4b5e293a-05ff-44d6-9fe9-a07aa72782de None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 25 03:36:01.205311 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4b5e293a-05ff-44d6-9fe9-a07aa72782de None None] Releasing lock "compute-rpcapi-router" {{(pid=123362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 25 03:36:01.230750 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4b5e293a-05ff-44d6-9fe9-a07aa72782de None None] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205197 Jan 25 03:36:01.231948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 73/125] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:36:01.258633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:01.259844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:01.268575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.269210 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.270017 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.270455 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.405621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:01.406883 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:01.413787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.414589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.416389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.417051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.665615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:01.690593 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e607d92a-9bdd-43d4-a15c-c12de6817fd1 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.289398 Jan 25 03:36:01.693393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 74/126] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:01 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:01.839970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:01.847435 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-49e33bc8-efd9-485d-a83e-e41d5a953ae2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.592338 Jan 25 03:36:01.848387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 53/127] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:01 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:01.979762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:01.980946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:01.987472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.988324 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:01.995995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:01.995995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:02.207694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:02.208600 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:02.216834 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:02.220086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:02.221184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:02.221710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:02.245109 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:02.255537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f3cf9e7b-86e0-4fba-bda2-75d307c4e8d3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.279636 Jan 25 03:36:02.265037 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 75/128] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:01 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:02.470562 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:02.483400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:02.489638 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:02.492753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-40547321-59e1-4f9f-99a2-a671b9812f44 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1343 microversion: 2.20 time: 0.289341 Jan 25 03:36:02.493520 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 54/129] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:02 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1343 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:02.708418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:02.709235 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:02.717341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:02.718063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:02.719816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:02.720640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:02.767138 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-c4194591-7779-4e9b-bad5-0adc518afb50 req-26f210b8-f50e-4c08-b6d9-b8c895a97a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d82b81-05dd-4075-8d84-577551c2a689", "tag": "29297f0b-07c1-43dd-9bc9-7ce2fc61fabf"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:02.768844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:02.768844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:02.777153 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-c4194591-7779-4e9b-bad5-0adc518afb50 req-26f210b8-f50e-4c08-b6d9-b8c895a97a4f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:02.779893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-c4194591-7779-4e9b-bad5-0adc518afb50 req-26f210b8-f50e-4c08-b6d9-b8c895a97a4f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:02.792818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-c4194591-7779-4e9b-bad5-0adc518afb50 req-26f210b8-f50e-4c08-b6d9-b8c895a97a4f service nova] Creating event network-changed:29297f0b-07c1-43dd-9bc9-7ce2fc61fabf for instance 17d82b81-05dd-4075-8d84-577551c2a689 on hv-cinder-81901 Jan 25 03:36:02.800451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-c4194591-7779-4e9b-bad5-0adc518afb50 req-26f210b8-f50e-4c08-b6d9-b8c895a97a4f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110147 Jan 25 03:36:02.803877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 76/130] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:02.870991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:02.872503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:02.880948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:02.881407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:02.882602 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:02.883176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:03.097272 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:03.105564 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ba1d53b7-a23c-40b6-a312-7f99d621daf8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.244361 Jan 25 03:36:03.106198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 77/131] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:02 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:03.276223 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:03.277135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:03.301342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:03.301342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:03.301342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:03.301342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:03.442377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:03.449419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-da4df838-0b12-4dcc-acc9-300f075d3212 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.744505 Jan 25 03:36:03.456583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 55/132] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:02 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:03.468165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:03.483035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3429b182-da6a-45b1-a23c-ab76a0d13248 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.208718 Jan 25 03:36:03.483035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 78/133] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:03 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:03.512554 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:03.513090 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:03.519459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:03.520048 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:03.520987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:03.521616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.068532 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:04.085903 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:04.088538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:04.090167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-99d4bbad-86fc-4c9f-97fe-aa6f1479c2dc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.582700 Jan 25 03:36:04.091147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 56/134] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:03 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:04.123262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:04.125855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:04.138727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:04.139588 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.141660 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:04.142366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.441190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:04.451764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-195b1397-eb14-43fc-9813-76acc222af38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.333597 Jan 25 03:36:04.454206 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 79/135] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:04 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:04.473531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:04.475327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:04.483485 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:04.484235 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.485640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:04.486473 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.498248 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:04.499140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:04.505390 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:04.506199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.507444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:04.508194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.851293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:04.859843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-50ea9056-a18a-4dfd-9460-523efc447ad5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.366696 Jan 25 03:36:04.860430 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 80/136] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:04 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:04.864933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-8e2d25c3-0c49-450e-a6c9-121afdf56ebe req-92d12edd-00ff-4f72-85ca-7d5e5f8c9ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "182d19da-cad7-4773-bd15-67d9285d2c1a", "tag": "1a2cf8cb-4a21-4b74-ab28-8d2bae03f13c"}, {"name": "network-changed", "server_uuid": "b83cc2c8-a438-49f9-b79c-e74359899f65", "tag": "565ed7d6-bff7-4ce1-97e7-071173dbd857"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:04.866974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:04.866974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:04.875162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-8e2d25c3-0c49-450e-a6c9-121afdf56ebe req-92d12edd-00ff-4f72-85ca-7d5e5f8c9ba2 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:04.875996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-8e2d25c3-0c49-450e-a6c9-121afdf56ebe req-92d12edd-00ff-4f72-85ca-7d5e5f8c9ba2 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:04.892496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-8e2d25c3-0c49-450e-a6c9-121afdf56ebe req-92d12edd-00ff-4f72-85ca-7d5e5f8c9ba2 service nova] Creating event network-changed:1a2cf8cb-4a21-4b74-ab28-8d2bae03f13c for instance 182d19da-cad7-4773-bd15-67d9285d2c1a on hv-cinder-81901 Jan 25 03:36:04.892496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-8e2d25c3-0c49-450e-a6c9-121afdf56ebe req-92d12edd-00ff-4f72-85ca-7d5e5f8c9ba2 service nova] Creating event network-changed:565ed7d6-bff7-4ce1-97e7-071173dbd857 for instance b83cc2c8-a438-49f9-b79c-e74359899f65 on hv-cinder-81901 Jan 25 03:36:04.897199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-8e2d25c3-0c49-450e-a6c9-121afdf56ebe req-92d12edd-00ff-4f72-85ca-7d5e5f8c9ba2 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035467 Jan 25 03:36:04.898403 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 81/137] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:05.108818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:05.118624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:05.118624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:05.118624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:05.119115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:05.119710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:05.203985 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:05.213681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e2ef1ff0-b5dc-4d16-9730-879fbb079481 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.741995 Jan 25 03:36:05.214931 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 57/138] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:04 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:05.420373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:05.425394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:05.427889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:05.429625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-35b7c5e5-2f2f-4389-87b5-3ed1dd32fbfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.324593 Jan 25 03:36:05.430951 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 82/139] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:05 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:05.469824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:05.470511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:05.478950 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:05.479789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:05.480266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:05.480707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:05.877155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:05.878292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:05.890651 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:05.897061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:05.909632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:05.909632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:06.070234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:06.090552 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f2120e77-9565-4141-b4ec-78af12f2c5ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.208820 Jan 25 03:36:06.104409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 83/140] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:05 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:06.231667 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:06.232432 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:06.238619 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:06.241088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:06.241088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:06.241088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:06.310300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:06.322815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cc9a750c-a8ec-40d6-9287-0ab943c75430 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.855358 Jan 25 03:36:06.324213 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 58/141] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:05 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:06.434070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:06.443104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3d5c5fe-fb23-436d-969d-8ad9878c095d tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.215770 Jan 25 03:36:06.456106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 84/142] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:06 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:06.456635 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:06.456635 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:06.462631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:06.463129 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:06.463936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:06.464557 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:06.732825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:06.764034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:06.764034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:06.764034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-16a8b400-2928-47f2-85db-e17a9b640164 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.320163 Jan 25 03:36:06.767666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 59/143] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:06 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:06.969015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-7debd492-724e-459d-8e7e-06e8772bff02 req-de91d66e-63a5-4e8b-9248-31e07eacbc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c1179f-67c0-4198-8933-7cabe5c964f3", "tag": "23790178-4f79-4bcf-a17f-bd8e5abf0427"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:06.969015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:06.969015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:06.979080 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-7debd492-724e-459d-8e7e-06e8772bff02 req-de91d66e-63a5-4e8b-9248-31e07eacbc0b service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:06.979816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-7debd492-724e-459d-8e7e-06e8772bff02 req-de91d66e-63a5-4e8b-9248-31e07eacbc0b service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:06.991420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-7debd492-724e-459d-8e7e-06e8772bff02 req-de91d66e-63a5-4e8b-9248-31e07eacbc0b service nova] Creating event network-changed:23790178-4f79-4bcf-a17f-bd8e5abf0427 for instance b5c1179f-67c0-4198-8933-7cabe5c964f3 on hv-cinder-81901 Jan 25 03:36:06.998727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-7debd492-724e-459d-8e7e-06e8772bff02 req-de91d66e-63a5-4e8b-9248-31e07eacbc0b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036111 Jan 25 03:36:06.999792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 85/144] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:07.108544 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:07.109397 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:07.116481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.117002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.118532 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.119497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.342167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:07.342863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:07.356582 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.357150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.357990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.358428 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.504873 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:07.514451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fc088a5f-d33d-4e9b-87e5-b73843e9230a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.409577 Jan 25 03:36:07.520576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 60/145] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:07 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:07.528721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:07.529338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:07.543498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.544111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.545074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.547588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.570703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:07.582642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-cf3490e5-3dc5-4584-a417-acf919d9383e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.245139 Jan 25 03:36:07.584874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 86/146] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:07 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:07.787708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:07.787708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:07.808409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.808979 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.811903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:07.812476 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:07.876953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:07.895122 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-721d5ef7-94a3-441a-9841-4ece4b92d9a7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.373057 Jan 25 03:36:07.906306 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 61/147] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:07 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:08.052515 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:08.063714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:08.065431 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:08.066919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2fb008e2-1f83-4966-a8a5-a660cf58e79e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.286039 Jan 25 03:36:08.068081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 87/148] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:07 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:08.533119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:08.549448 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:08.567302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:08.569516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:08.574379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:08.575005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:08.602197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:08.603501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:08.613373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:08.621167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:08.622587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:08.623575 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:08.878944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:08.894447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1ccc4f6d-79e2-4150-8a33-3d61bcfe9ef4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.366758 Jan 25 03:36:08.896573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 62/149] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:08 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:08.917501 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:08.933291 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:08.942761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:08.944349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:08.945373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:08.945847 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:09.075900 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:09.087708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-76487690-2bf9-47d9-b19c-ce1b2e35052b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.488944 Jan 25 03:36:09.098858 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 88/150] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:08 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:09.105140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:09.107693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:09.112668 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:09.113720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:09.114747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:09.115433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:09.141892 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:09.149495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9622169f-5e84-49a1-87df-db5e464eee43 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.240350 Jan 25 03:36:09.150703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 63/151] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:08 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:09.381412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:09.389917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:09.391754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:09.392856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-691f7635-a142-430e-962f-e2a2eac437f9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.292723 Jan 25 03:36:09.396002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 89/152] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:09 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:09.914021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:09.916493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:09.936060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:09.936060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:09.936060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:09.936060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:10.106622 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:10.107443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:10.120902 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:10.128543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:10.128543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:10.128543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:10.209267 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:10.217747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6e8ea1cc-fe02-4b60-bc41-e68290834760 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.308580 Jan 25 03:36:10.220253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 64/153] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:09 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:10.223598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:10.224691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:10.231748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:10.232278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:10.233027 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:10.233454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:10.397443 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:10.406318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-589e50f5-db7a-4ba1-8842-2f13a744855a tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.186956 Jan 25 03:36:10.407602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 65/154] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:10 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:10.412340 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:10.413082 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:10.421445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:10.421969 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:10.423831 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:10.423831 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:10.595710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:10.606083 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:10.611890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:10.613169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-398febba-1971-408f-8b70-8e1356034eae tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.204390 Jan 25 03:36:10.616136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 66/155] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:10 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:10.898412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:10.907287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0e30522f-0132-482e-884e-5a72ad9f25f2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.806172 Jan 25 03:36:10.911581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 90/156] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:10 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:11.184957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-7fe9a3cc-9739-4a2e-8887-d2a5a15c62ec req-90e62a15-fc5d-402c-9bd2-395407aa0f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a", "name": "network-vif-plugged", "status": "completed", "tag": "7a3865a4-17c6-440a-8dd3-3ff9c0e019f2"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:11.187834 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:11.187834 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:36:11.214126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-7fe9a3cc-9739-4a2e-8887-d2a5a15c62ec req-90e62a15-fc5d-402c-9bd2-395407aa0f50 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.214562 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-7fe9a3cc-9739-4a2e-8887-d2a5a15c62ec req-90e62a15-fc5d-402c-9bd2-395407aa0f50 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.234237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:11.235595 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:11.247374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.249338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.249338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.249338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.261876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-7fe9a3cc-9739-4a2e-8887-d2a5a15c62ec req-90e62a15-fc5d-402c-9bd2-395407aa0f50 service nova] Creating event network-vif-plugged:7a3865a4-17c6-440a-8dd3-3ff9c0e019f2 for instance 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a on hv-cinder-81901 Jan 25 03:36:11.264956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-7fe9a3cc-9739-4a2e-8887-d2a5a15c62ec req-90e62a15-fc5d-402c-9bd2-395407aa0f50 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123363) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 25 03:36:11.267857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d0f1a3f-f248-45b8-8d5c-46e8b94e3490 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.268304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d0f1a3f-f248-45b8-8d5c-46e8b94e3490 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.269133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d0f1a3f-f248-45b8-8d5c-46e8b94e3490 None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.269527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d0f1a3f-f248-45b8-8d5c-46e8b94e3490 None None] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.281422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.compute.rpcapi [None req-9d0f1a3f-f248-45b8-8d5c-46e8b94e3490 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 25 03:36:11.282480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d0f1a3f-f248-45b8-8d5c-46e8b94e3490 None None] Releasing lock "compute-rpcapi-router" {{(pid=123363) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 25 03:36:11.315315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9d0f1a3f-f248-45b8-8d5c-46e8b94e3490 None None] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199647 Jan 25 03:36:11.318600 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 67/157] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:11.424937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:11.425741 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:11.438130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.438598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.439431 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.439874 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.448727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:11.459687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-22045ed7-e76f-4d21-b5e8-066bf76df9ab tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.224586 Jan 25 03:36:11.472728 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 91/158] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:11 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:11.634377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:11.634990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:11.647935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.650897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.652777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.654313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.703614 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:11.713500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f240cc6a-2135-4bd4-83f5-ff75f89ab057 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.292878 Jan 25 03:36:11.714415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 68/159] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:11 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:11.927443 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:11.928042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:11.937167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.937167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.937167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:11.937167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:11.956755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:11.965438 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:11.967250 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:11.968708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fbe33160-222e-48e0-a95d-177e7e3b9759 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.339014 Jan 25 03:36:11.969629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 92/160] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:11 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:12.107965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:12.112141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4f91fc95-0966-435e-b1be-ef9e5904ac1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.188241 Jan 25 03:36:12.112871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 69/161] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:11 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:12.481072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:12.482164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:12.492039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:12.492039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:12.493894 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:12.494570 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:12.687424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:12.708376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5501c03d-c8e9-445f-a9d4-5022ab506731 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.234830 Jan 25 03:36:12.710620 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 93/162] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:12 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:12.732564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:12.733887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:12.747472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:12.747926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:12.748713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:12.749127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:12.943575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:12.952402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-57081db8-8f89-435f-aca3-cf14e2b12ec2 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.226255 Jan 25 03:36:12.953246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 70/163] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:12 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:12.987835 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:12.988528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:12.995224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:12.995753 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:12.996623 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:12.997130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:13.132958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:13.133572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:13.140307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:13.140765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:13.141563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:13.142341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:13.146114 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:13.163495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:13.165589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:13.166708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-dd33ed5c-f84c-4ff9-906c-44a6751d27c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.182601 Jan 25 03:36:13.167301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 94/164] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:12 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:13.283719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:13.294274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-83494ddd-9eff-4127-b309-58c8c8327502 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.168217 Jan 25 03:36:13.295680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 71/165] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:13 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:13.339155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-a681d426-8fce-4fb7-90a9-56cdac0a0ed1 req-377c094e-9820-41c0-9fc8-8c42c70be9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83cc2c8-a438-49f9-b79c-e74359899f65", "name": "network-vif-plugged", "status": "completed", "tag": "565ed7d6-bff7-4ce1-97e7-071173dbd857"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:13.340786 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:13.340786 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:13.360792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a681d426-8fce-4fb7-90a9-56cdac0a0ed1 req-377c094e-9820-41c0-9fc8-8c42c70be9c4 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:13.363451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a681d426-8fce-4fb7-90a9-56cdac0a0ed1 req-377c094e-9820-41c0-9fc8-8c42c70be9c4 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:13.386058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-a681d426-8fce-4fb7-90a9-56cdac0a0ed1 req-377c094e-9820-41c0-9fc8-8c42c70be9c4 service nova] Creating event network-vif-plugged:565ed7d6-bff7-4ce1-97e7-071173dbd857 for instance b83cc2c8-a438-49f9-b79c-e74359899f65 on hv-cinder-81901 Jan 25 03:36:13.398519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-a681d426-8fce-4fb7-90a9-56cdac0a0ed1 req-377c094e-9820-41c0-9fc8-8c42c70be9c4 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061621 Jan 25 03:36:13.400898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 95/166] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:13.727724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:13.729547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:13.736641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:13.738006 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:13.740277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:13.740823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:13.971321 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:13.971321 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:13.981562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:13.983649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:13.988700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:13.989435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:14.006730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:14.017171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0cbc8002-7c30-4da7-a0f4-70da64b51d08 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.294135 Jan 25 03:36:14.018110 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 72/167] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:13 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:14.183836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:14.185966 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:14.186636 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:14.192825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:14.193274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:14.194224 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:14.194694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:14.197140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2b14ca76-8bdb-4dfc-b419-df0fc47bb9ce tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.230824 Jan 25 03:36:14.198031 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 96/168] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:13 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:14.313705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:14.314316 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:14.320485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:14.324097 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:14.326919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:14.327803 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:14.328240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:14.333064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:14.335649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:14.337169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d86cb521-d333-410e-844b-6c1044100c6a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.154963 Jan 25 03:36:14.346948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 73/169] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:14 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:14.474799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:14.482399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2dcb4871-a1a5-4608-a62a-4184986e3579 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1326 microversion: 2.1 time: 0.172271 Jan 25 03:36:14.483151 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 97/170] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:14 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:15.035898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:15.037388 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:15.047652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.048100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.048870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.049295 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.217282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:15.218066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:15.225983 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.226435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.227758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.228194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.278761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:15.287036 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4a85b76b-0990-4e68-99e1-3794d6161539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1322 microversion: 2.1 time: 0.255948 Jan 25 03:36:15.293014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 74/171] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:15 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:15.355153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:15.356046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:15.363845 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.364539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.365546 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.366173 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.521001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:15.531523 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-eee287b3-26c3-4380-9244-a49707429d35 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.317952 Jan 25 03:36:15.532658 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 98/172] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:15 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:15.544406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-04b14492-f03c-45e3-90a5-2ecbb70351f8 req-d612e053-e57e-437c-bbea-c5c9413667a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d82b81-05dd-4075-8d84-577551c2a689", "name": "network-vif-plugged", "status": "completed", "tag": "29297f0b-07c1-43dd-9bc9-7ce2fc61fabf"}, {"server_uuid": "182d19da-cad7-4773-bd15-67d9285d2c1a", "name": "network-vif-plugged", "status": "completed", "tag": "1a2cf8cb-4a21-4b74-ab28-8d2bae03f13c"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:15.544406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:15.544406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:15.550479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-04b14492-f03c-45e3-90a5-2ecbb70351f8 req-d612e053-e57e-437c-bbea-c5c9413667a3 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.550910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-04b14492-f03c-45e3-90a5-2ecbb70351f8 req-d612e053-e57e-437c-bbea-c5c9413667a3 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.571440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-04b14492-f03c-45e3-90a5-2ecbb70351f8 req-d612e053-e57e-437c-bbea-c5c9413667a3 service nova] Creating event network-vif-plugged:29297f0b-07c1-43dd-9bc9-7ce2fc61fabf for instance 17d82b81-05dd-4075-8d84-577551c2a689 on hv-cinder-81901 Jan 25 03:36:15.571968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-04b14492-f03c-45e3-90a5-2ecbb70351f8 req-d612e053-e57e-437c-bbea-c5c9413667a3 service nova] Creating event network-vif-plugged:1a2cf8cb-4a21-4b74-ab28-8d2bae03f13c for instance 182d19da-cad7-4773-bd15-67d9285d2c1a on hv-cinder-81901 Jan 25 03:36:15.579487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-04b14492-f03c-45e3-90a5-2ecbb70351f8 req-d612e053-e57e-437c-bbea-c5c9413667a3 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045368 Jan 25 03:36:15.580511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 99/173] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:15.583769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:15.592686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:15.597812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:15.598543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:15.603619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:15.605612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-24cf67c8-1947-40a2-9f86-50f9dc96926a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.254384 Jan 25 03:36:15.606698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 75/174] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:15 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:15.608861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.609474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.610557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.611002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.803719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:15.811094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9e810c77-2f90-443f-9255-b6cfc1aa4c69 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1520 microversion: 2.1 time: 0.217224 Jan 25 03:36:15.811942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 100/175] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:15 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:15.834380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:15.835390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:15.843400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.843844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.844627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:15.845118 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:15.907028 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lazy-loading 'flavor' on Instance uuid 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:36:16.292757 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c83023fc-6ce8-4f4e-83ec-bcba3ccf6bd9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a/action" status: 200 len: 32 microversion: 2.1 time: 0.462047 Jan 25 03:36:16.293361 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 76/176] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:36:15 2022] POST /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:36:16.302307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:16.308872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:16.311455 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:16.312179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:16.315758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.316437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.317231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.317672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.318168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.318617 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.319424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.319857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.532694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:16.540959 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b40ab31d-c6aa-406c-9727-50cb3e6da2f6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1512 microversion: 2.1 time: 0.236798 Jan 25 03:36:16.542206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 77/177] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:16 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:16.558489 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:16.558686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:16.559119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:16.567016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d4f56070-e7dd-415d-aa15-3e9bbf5e46c6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.268445 Jan 25 03:36:16.578457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 101/178] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:16 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:16.578593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.578593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.578593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.578593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.629355 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:16.629976 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:16.644292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.646933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.648456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:16.649523 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:16.814274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:16.824017 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-121bae42-779a-4abf-91e1-cb6937e2e499 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.270027 Jan 25 03:36:16.835385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 78/179] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:16 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:16.848849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:16.859527 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:16.861065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:16.862175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ec3c1fee-60f5-490d-8acd-b70054f9164d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.241488 Jan 25 03:36:16.874454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 102/180] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:16 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:17.586947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:17.588014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:17.595096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:17.595917 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:17.596690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:17.597131 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:17.599590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-ca735cd1-5ec8-403d-9103-62857415e633 req-d56922b8-db5d-45b3-9f17-654a264d6d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c1179f-67c0-4198-8933-7cabe5c964f3", "name": "network-vif-plugged", "status": "completed", "tag": "23790178-4f79-4bcf-a17f-bd8e5abf0427"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:17.601426 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:17.601426 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:17.610991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-ca735cd1-5ec8-403d-9103-62857415e633 req-d56922b8-db5d-45b3-9f17-654a264d6d91 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:17.611652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-ca735cd1-5ec8-403d-9103-62857415e633 req-d56922b8-db5d-45b3-9f17-654a264d6d91 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:17.624942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-ca735cd1-5ec8-403d-9103-62857415e633 req-d56922b8-db5d-45b3-9f17-654a264d6d91 service nova] Creating event network-vif-plugged:23790178-4f79-4bcf-a17f-bd8e5abf0427 for instance b5c1179f-67c0-4198-8933-7cabe5c964f3 on hv-cinder-81901 Jan 25 03:36:17.630542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-ca735cd1-5ec8-403d-9103-62857415e633 req-d56922b8-db5d-45b3-9f17-654a264d6d91 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036471 Jan 25 03:36:17.631372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 103/181] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:36:17.744067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:17.751548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1ebc90fa-3ce4-4efc-b895-661e23620096 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.168890 Jan 25 03:36:17.752120 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 79/182] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:17 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:17.843306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:17.843306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:17.850577 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:17.851034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:17.851839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:17.852771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:17.891913 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:17.892517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:17.900086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:17.900531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:17.901314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:17.902079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:18.004153 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:18.014940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7d82c1ec-78fe-432f-a301-22617627c3fd tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.175262 Jan 25 03:36:18.016756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 104/183] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:17 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:18.059558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:18.068099 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:18.069789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:18.071505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-341d903c-e62b-4f9e-a26b-7ff9f6971040 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.183384 Jan 25 03:36:18.072055 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 80/184] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:17 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:18.768542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:18.769172 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:18.775404 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:18.775854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:18.776679 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:18.777118 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:18.919119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:18.928071 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-233a77bc-6a35-4fa1-8cfb-6a257e48011a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.163118 Jan 25 03:36:18.928646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 105/185] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:18 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:19.034117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:19.035336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:19.042239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:19.042687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:19.043488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:19.043915 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:19.091172 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:19.092017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:19.098762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:19.099473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:19.100602 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:19.101044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:19.216733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:19.224052 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e6e045e8-ed8b-41a8-9d1b-eeebc5c9c2d7 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.193697 Jan 25 03:36:19.224745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 81/186] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:19 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:19.261661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:19.269362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:19.270874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:19.272010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-787c82ff-76a9-44b5-af35-d2bd24e84038 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.186139 Jan 25 03:36:19.272572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 106/187] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:19 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:19.947291 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:19.947922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:19.954228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:19.954686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:19.955497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:19.960114 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:20.101326 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:20.108641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3c839faf-1ec1-4834-b654-870747c0eb1d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.165512 Jan 25 03:36:20.109225 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 82/188] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:19 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:20.241175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:20.241787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:20.247980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:20.248434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:20.249675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:20.250171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:20.289499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:20.290106 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:20.296847 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:20.297401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:20.298382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:20.298928 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:20.387786 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:20.395161 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a16d1f9a-cf77-4137-af69-ed245cbf4410 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.157523 Jan 25 03:36:20.404604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 107/189] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:20 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:20.435384 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:20.443408 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:20.444911 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:20.446352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-76907715-1173-43f6-8bd1-51616a62f099 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.160490 Jan 25 03:36:20.446917 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 83/190] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:20 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:21.159284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:21.159896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:21.167891 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.168643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:21.169454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.170494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:21.323050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:21.331613 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-79af381f-c0d0-428a-844d-a5bfeb8067ba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.176101 Jan 25 03:36:21.332197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 108/191] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:21 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:21.411840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:21.412601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:21.419588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.420034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:21.420815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.421245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:21.466753 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:21.467840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:21.474592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.475051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:21.475911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.476347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:21.651175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:21.663607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:21.673196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7a4915b3-8e64-4d21-8b13-e73173e165be tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.265061 Jan 25 03:36:21.674009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:21.675781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:21.679184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 84/192] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:21 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:21.679327 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3941d60-ae22-45f3-92af-c4bc7d95065b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.217003 Jan 25 03:36:21.679327 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 109/193] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:21 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:21.702857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-06b28a54-366a-4845-8410-6d5caacf181b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb508e8-dbd2-4f61-901c-7db7fdcf6967"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:21.704046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-06b28a54-366a-4845-8410-6d5caacf181b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:21.709947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06b28a54-366a-4845-8410-6d5caacf181b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.710422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06b28a54-366a-4845-8410-6d5caacf181b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:21.711377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06b28a54-366a-4845-8410-6d5caacf181b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:21.711800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06b28a54-366a-4845-8410-6d5caacf181b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:22.351560 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:22.351560 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:22.356634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:22.357085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:22.357922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:22.358347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:22.489835 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:22.497371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-43803c1a-c548-4e95-a8ab-2feddcc7795c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.151979 Jan 25 03:36:22.497942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 110/194] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:22 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:22.694928 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:22.696293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:22.702855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:22.703545 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:22.704379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:22.704809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:22.831980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:22.839851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-998638eb-fe63-4742-914d-34e371e1cc72 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.149991 Jan 25 03:36:22.840453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 111/195] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:22 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:22.845006 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:22.845970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:22.851181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:22.852384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:22.853133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:22.853561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:22.990829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:23.007536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:23.009303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:23.010521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-52082711-4463-4de2-b9b8-5d043b26dce2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.168815 Jan 25 03:36:23.011221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 112/196] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:22 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:23.514603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:23.515317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:23.521472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:23.526207 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:23.526207 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:23.526207 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:23.652892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:23.660339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c79287e3-af0c-481e-b8c6-d77b6e4319a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.149623 Jan 25 03:36:23.660908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 113/197] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:23 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:23.856338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:23.856871 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:23.862757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:23.863259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:23.864033 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:23.864499 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:23.993271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:24.000506 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-eff1b0f0-f26a-49b0-b6f7-d2621fa25193 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.147907 Jan 25 03:36:24.001079 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 114/198] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:23 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:24.028210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:24.028819 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:24.034722 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:24.035227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:24.036028 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:24.036459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:24.171038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:24.178799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:24.181049 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:24.182174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-605919f6-dfbe-4c0c-8356-522f6a4ba7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.157768 Jan 25 03:36:24.182740 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 115/199] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:24 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:24.676953 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:24.677578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:24.683345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:24.683794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:24.684567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:24.685007 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:24.817809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:24.826097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6a26518e-8b2f-4945-aab6-8f562d48c382 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.152802 Jan 25 03:36:24.826665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 116/200] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:24 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:25.018862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:25.019431 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:25.025367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:25.032330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:25.032330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:25.032330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:25.156267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:25.163749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0db47a60-496e-49e6-98ea-08adb4140441 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.149254 Jan 25 03:36:25.165191 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 117/201] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:25 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:25.200025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:25.200712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:25.206583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:25.207036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:25.207875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:25.208308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:25.342273 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:25.350222 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:25.351830 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:25.352917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bd0adfc1-f45f-455b-bd44-2d89441039fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.157097 Jan 25 03:36:25.353574 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 118/202] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:25 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:25.842948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:25.844421 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:25.850339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:25.850802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:25.851860 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:25.852467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:26.030872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:26.038709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-eb96f212-ae1d-484a-aa04-27e77fcc2c02 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.199383 Jan 25 03:36:26.039374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 119/203] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:25 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:26.181941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:26.182565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:26.188484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:26.188937 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:26.189707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:26.190180 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:26.321982 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:26.329467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3beefcfe-ee23-4e87-8cae-0d001c73a873 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1319 microversion: 2.1 time: 0.152159 Jan 25 03:36:26.330041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 120/204] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:26 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:26.370406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:26.371150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:26.377167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:26.377687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:26.378549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:26.379078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:26.513954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:26.521890 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:26.523981 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:26.525123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-54c5adda-4c7e-43ef-b960-0935363b78a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.158937 Jan 25 03:36:26.525671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 121/205] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:26 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:27.054803 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:27.055394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:27.062141 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:27.062590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:27.063410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:27.063941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:27.241553 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:27.249383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bb94a3ff-1337-4964-a00f-d0d0b5196109 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.198510 Jan 25 03:36:27.249885 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 122/206] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:27 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:27.345582 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:27.346184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:27.353011 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:27.367619 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:27.367619 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:27.367619 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:27.496802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:27.504339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2e8f7bb6-a5fd-4384-a83c-84edda81815e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1506 microversion: 2.1 time: 0.162339 Jan 25 03:36:27.504846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 123/207] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:27 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:27.543002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:27.543639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:27.549592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:27.550264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:27.550932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:27.551549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:27.687516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-06b28a54-366a-4845-8410-6d5caacf181b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.987867 Jan 25 03:36:27.689488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 85/208] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:36:21 2022] POST /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments => generated 194 bytes in 5991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:27.694616 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:27.704099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:27.705581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:27.713031 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d63c0d88-dc76-4279-9762-356ec9b15d1a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.172716 Jan 25 03:36:27.716844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 124/209] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:27 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:28.274440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:28.275574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:28.284900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:28.284900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:28.288416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:28.288416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:28.448108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:28.456480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6d84ca91-6b5a-43ee-ad52-efd985fbbfd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.187011 Jan 25 03:36:28.457698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 86/210] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:28 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:28.730068 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:28.730677 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:28.749172 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:28.750115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:28.751078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:28.751675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:28.919688 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:28.927991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:28.929823 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:28.930932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9efb05b8-301f-4566-9209-84905282c151 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1411 microversion: 2.20 time: 0.205215 Jan 25 03:36:28.931517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 125/211] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:28 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1411 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:29.473526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:29.474168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:29.481110 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:29.481560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:29.482330 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:29.482767 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:29.764465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:29.771582 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-913ef434-20f7-4469-b46f-47a4f1a2af98 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.301785 Jan 25 03:36:29.772150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 87/212] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:29 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:29.949995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:29.950618 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:29.956537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:29.957022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:29.957786 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:29.958217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:30.087320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:30.095088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:30.096594 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:30.097735 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6fc5b05e-ee51-4468-ac5d-ac028d1b4e21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1602 microversion: 2.20 time: 0.152763 Jan 25 03:36:30.098294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 126/213] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:36:29 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1602 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:30.115938 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-26bf5ff6-bc06-4c38-bbf1-cd4cba8bd1d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:30.116430 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-26bf5ff6-bc06-4c38-bbf1-cd4cba8bd1d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:30.122721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26bf5ff6-bc06-4c38-bbf1-cd4cba8bd1d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:30.123208 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26bf5ff6-bc06-4c38-bbf1-cd4cba8bd1d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:30.126745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26bf5ff6-bc06-4c38-bbf1-cd4cba8bd1d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:30.126745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26bf5ff6-bc06-4c38-bbf1-cd4cba8bd1d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:30.202768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-26bf5ff6-bc06-4c38-bbf1-cd4cba8bd1d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090409 Jan 25 03:36:30.203413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 88/214] 10.222.0.115 () {60 vars in 1320 bytes} [Tue Jan 25 03:36:30 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:36:30.380992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9e21ddd4-7d68-4a8e-a672-fc18d41912e5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54a1ee7b-c8b7-41ba-9d53-fa91547c6f57"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:30.382111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9e21ddd4-7d68-4a8e-a672-fc18d41912e5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:30.388591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e21ddd4-7d68-4a8e-a672-fc18d41912e5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:30.389328 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e21ddd4-7d68-4a8e-a672-fc18d41912e5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:30.390174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e21ddd4-7d68-4a8e-a672-fc18d41912e5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:30.390597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e21ddd4-7d68-4a8e-a672-fc18d41912e5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:30.789472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:30.790794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:30.797171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:30.797853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:30.798678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:30.799382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:31.071138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:31.078683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b60f1833-4ff5-4fce-9faf-4b4398d40a18 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.293026 Jan 25 03:36:31.079306 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 89/215] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:30 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:31.697932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9bd6d01d-1ffa-4213-9fac-c142ac4ad5bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:31.698954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9bd6d01d-1ffa-4213-9fac-c142ac4ad5bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:31.705528 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9bd6d01d-1ffa-4213-9fac-c142ac4ad5bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:31.706070 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9bd6d01d-1ffa-4213-9fac-c142ac4ad5bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:31.706905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9bd6d01d-1ffa-4213-9fac-c142ac4ad5bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:31.707440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9bd6d01d-1ffa-4213-9fac-c142ac4ad5bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:34.515879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9bd6d01d-1ffa-4213-9fac-c142ac4ad5bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 2.823162 Jan 25 03:36:34.516583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 90/216] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:31 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 2825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:34.521326 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-3ed080de-8326-4430-9d4e-850287a755bb req-f75d213b-5970-4cac-aca0-96b12e6ff5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c1179f-67c0-4198-8933-7cabe5c964f3", "tag": "23790178-4f79-4bcf-a17f-bd8e5abf0427"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:34.522828 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:34.522828 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:36:34.531304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-3ed080de-8326-4430-9d4e-850287a755bb req-f75d213b-5970-4cac-aca0-96b12e6ff5a7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:34.531758 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-3ed080de-8326-4430-9d4e-850287a755bb req-f75d213b-5970-4cac-aca0-96b12e6ff5a7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:34.542807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-3ed080de-8326-4430-9d4e-850287a755bb req-f75d213b-5970-4cac-aca0-96b12e6ff5a7 service nova] Creating event network-changed:23790178-4f79-4bcf-a17f-bd8e5abf0427 for instance b5c1179f-67c0-4198-8933-7cabe5c964f3 on hv-cinder-81901 Jan 25 03:36:34.547859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-3ed080de-8326-4430-9d4e-850287a755bb req-f75d213b-5970-4cac-aca0-96b12e6ff5a7 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030060 Jan 25 03:36:34.548616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 91/217] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:34.553701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:34.554453 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:34.561189 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:34.561685 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:34.562410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:34.562842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:34.779312 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:34.787021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-af63b9c7-0c25-4c8b-bb06-5d2da588139a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.237126 Jan 25 03:36:34.787700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 92/218] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:34 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:35.103761 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9e21ddd4-7d68-4a8e-a672-fc18d41912e5 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "POST /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.726469 Jan 25 03:36:35.104664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 127/219] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:36:30 2022] POST /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a/os-volume_attachments => generated 194 bytes in 4728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:35.527446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c9ab1757-df6b-4ecc-a83b-f3f416edc981 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:35.528361 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c9ab1757-df6b-4ecc-a83b-f3f416edc981 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:35.534589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9ab1757-df6b-4ecc-a83b-f3f416edc981 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:35.535038 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9ab1757-df6b-4ecc-a83b-f3f416edc981 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:35.535842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9ab1757-df6b-4ecc-a83b-f3f416edc981 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:35.536305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9ab1757-df6b-4ecc-a83b-f3f416edc981 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:35.644228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c9ab1757-df6b-4ecc-a83b-f3f416edc981 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.120898 Jan 25 03:36:35.645037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 93/220] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:35 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:35.806100 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:35.806881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:35.813484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:35.813937 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:35.814716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:35.815181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:35.948990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:35.956966 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2faeacda-0025-424c-8afe-673717316f7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.155468 Jan 25 03:36:35.957590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 128/221] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:35 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:36.656684 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a9844ddc-6fdc-4e5f-b7cf-a6c46ca1b809 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:36.657889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a9844ddc-6fdc-4e5f-b7cf-a6c46ca1b809 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:36.664652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a9844ddc-6fdc-4e5f-b7cf-a6c46ca1b809 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:36.665170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a9844ddc-6fdc-4e5f-b7cf-a6c46ca1b809 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:36.666840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a9844ddc-6fdc-4e5f-b7cf-a6c46ca1b809 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:36.667515 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a9844ddc-6fdc-4e5f-b7cf-a6c46ca1b809 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:36.777268 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a9844ddc-6fdc-4e5f-b7cf-a6c46ca1b809 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.125165 Jan 25 03:36:36.777905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 94/222] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:36 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:36.978886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:36.978886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:36.980739 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:36.981196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:36.982064 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:36.982406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:37.116557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:37.122484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-397401da-5a19-4187-a369-3b2af9311ef8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.152542 Jan 25 03:36:37.123068 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 129/223] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:36 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:37.788281 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f2713b0e-b8c9-414c-87bd-d57fc9b13b38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:37.789308 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f2713b0e-b8c9-414c-87bd-d57fc9b13b38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:37.796853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2713b0e-b8c9-414c-87bd-d57fc9b13b38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:37.797310 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2713b0e-b8c9-414c-87bd-d57fc9b13b38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:37.798136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2713b0e-b8c9-414c-87bd-d57fc9b13b38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:37.798562 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2713b0e-b8c9-414c-87bd-d57fc9b13b38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:37.912748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f2713b0e-b8c9-414c-87bd-d57fc9b13b38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.128257 Jan 25 03:36:37.913383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 95/224] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:37 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:38.140325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:38.140957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:38.147364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:38.147818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:38.148599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:38.149040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:38.286019 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:38.294489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e03de90c-dbbc-4ce6-b450-c211862911d6 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.158904 Jan 25 03:36:38.295312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 130/225] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:38 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:38.925166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c1851d12-c19f-48cd-a5a4-a83ccb2f4e49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:38.930158 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c1851d12-c19f-48cd-a5a4-a83ccb2f4e49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:38.933971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1851d12-c19f-48cd-a5a4-a83ccb2f4e49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:38.934419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1851d12-c19f-48cd-a5a4-a83ccb2f4e49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:38.935230 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1851d12-c19f-48cd-a5a4-a83ccb2f4e49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:38.935776 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c1851d12-c19f-48cd-a5a4-a83ccb2f4e49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:39.078612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c1851d12-c19f-48cd-a5a4-a83ccb2f4e49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.156197 Jan 25 03:36:39.078612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 96/226] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:38 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:39.311990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:39.312500 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:39.318812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:39.319296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:39.320077 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:39.320544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:39.583205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:39.591031 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1c342166-5e1f-4b8f-a3ce-9d6cffb69f9a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.282765 Jan 25 03:36:39.591652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 131/227] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:39 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:40.089164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-00cd7d81-4855-4f65-b5c4-be018782cb20 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:40.090213 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-00cd7d81-4855-4f65-b5c4-be018782cb20 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:40.097341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00cd7d81-4855-4f65-b5c4-be018782cb20 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:40.097792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00cd7d81-4855-4f65-b5c4-be018782cb20 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:40.098583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00cd7d81-4855-4f65-b5c4-be018782cb20 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:40.099025 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00cd7d81-4855-4f65-b5c4-be018782cb20 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:40.246037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-00cd7d81-4855-4f65-b5c4-be018782cb20 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.161517 Jan 25 03:36:40.246677 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 97/228] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:40 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:40.614374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:40.614374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:40.618211 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:40.618832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:40.620176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:40.620901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:40.766095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:40.773308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-54b8de97-b708-48b3-9241-1520aed36865 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.168012 Jan 25 03:36:40.773874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 132/229] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:40 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:41.257466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-dfe07dfb-d1b8-4d55-9080-4145958ab450 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:41.258377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-dfe07dfb-d1b8-4d55-9080-4145958ab450 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:41.265631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfe07dfb-d1b8-4d55-9080-4145958ab450 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:41.266079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfe07dfb-d1b8-4d55-9080-4145958ab450 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:41.266847 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfe07dfb-d1b8-4d55-9080-4145958ab450 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:41.267309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfe07dfb-d1b8-4d55-9080-4145958ab450 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:41.417517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-dfe07dfb-d1b8-4d55-9080-4145958ab450 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.164016 Jan 25 03:36:41.418690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 98/230] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:41 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:41.791972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:41.793188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:41.801528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:41.801988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:41.802773 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:41.803239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:42.085039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:42.097034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e78e3cf0-283e-4c79-9e09-fb4dc6fd0860 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.307056 Jan 25 03:36:42.097034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 133/231] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:41 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:42.429182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-115eb6ee-8eea-49b6-9aae-a3cbaada70c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:42.430175 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-115eb6ee-8eea-49b6-9aae-a3cbaada70c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:42.439454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-115eb6ee-8eea-49b6-9aae-a3cbaada70c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:42.439903 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-115eb6ee-8eea-49b6-9aae-a3cbaada70c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:42.442581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-115eb6ee-8eea-49b6-9aae-a3cbaada70c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:42.443240 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-115eb6ee-8eea-49b6-9aae-a3cbaada70c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:42.578620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-115eb6ee-8eea-49b6-9aae-a3cbaada70c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.153378 Jan 25 03:36:42.586205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 99/232] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:42 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:43.111416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:43.113206 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:43.120886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:43.122009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:43.139155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:43.140103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:43.397818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:43.405588 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-efd4dfa0-6d35-44c9-8c58-7cc13f10a629 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.298399 Jan 25 03:36:43.406148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 134/233] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:43 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:43.595864 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6c61bdc1-5648-42d7-af37-0d86a2d5f00c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:43.596862 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6c61bdc1-5648-42d7-af37-0d86a2d5f00c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:43.604214 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c61bdc1-5648-42d7-af37-0d86a2d5f00c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:43.604876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c61bdc1-5648-42d7-af37-0d86a2d5f00c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:43.605656 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c61bdc1-5648-42d7-af37-0d86a2d5f00c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:43.606093 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c61bdc1-5648-42d7-af37-0d86a2d5f00c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:44.421850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:44.422491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:44.428427 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:44.428877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:44.429740 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:44.430179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:44.577952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:44.585810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1b652e2a-32be-47b2-8a93-2a0270d9d1a9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.167325 Jan 25 03:36:44.587218 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 135/234] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:44 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:45.603788 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:45.604439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:45.610384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:45.610829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:45.611634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:45.612066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:45.777473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:45.785962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-efe1e5bb-6191-466e-8a26-e70e45ee794b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.185846 Jan 25 03:36:45.787315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 136/235] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:45 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:46.806095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:46.807373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:46.814026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:46.814495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:46.815330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:46.815775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:46.985407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:46.991365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fbf346a5-a5c6-4d10-bef3-1cb3ac3f0a5b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.189498 Jan 25 03:36:46.991929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 137/236] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:46 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:47.438133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6c61bdc1-5648-42d7-af37-0d86a2d5f00c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 3.846237 Jan 25 03:36:47.441932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 100/237] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:43 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 3849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:48.008597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:48.009268 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:48.016169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:48.016589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:48.017451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:48.017961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:48.391269 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:48.405808 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-21363aa9-422e-451c-88b2-fb6a5052965d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.398240 Jan 25 03:36:48.407499 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 138/238] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:48 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:48.450336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e78953f6-3de2-4b55-a149-9591e1cae175 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:48.451482 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e78953f6-3de2-4b55-a149-9591e1cae175 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:48.468511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e78953f6-3de2-4b55-a149-9591e1cae175 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:48.469097 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e78953f6-3de2-4b55-a149-9591e1cae175 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:48.472824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e78953f6-3de2-4b55-a149-9591e1cae175 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:48.473484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e78953f6-3de2-4b55-a149-9591e1cae175 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:48.597040 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e78953f6-3de2-4b55-a149-9591e1cae175 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 14 microversion: 2.20 time: 0.151547 Jan 25 03:36:48.597927 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 101/239] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:48 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:49.587659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:49.587659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:49.587659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:49.587659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:49.590364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:49.590364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:49.590364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:49.590787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c534e2b5-e07b-419b-aa06-204a23bcbc4b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.150835 Jan 25 03:36:49.590787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 139/240] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:49 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:49.608259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-776a5a73-b133-447a-bfc2-3438fc46e408 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:49.609263 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-776a5a73-b133-447a-bfc2-3438fc46e408 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:49.616981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-776a5a73-b133-447a-bfc2-3438fc46e408 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:49.617458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-776a5a73-b133-447a-bfc2-3438fc46e408 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:49.618668 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-776a5a73-b133-447a-bfc2-3438fc46e408 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:49.619353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-776a5a73-b133-447a-bfc2-3438fc46e408 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:49.742347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-776a5a73-b133-447a-bfc2-3438fc46e408 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 2041 microversion: 2.20 time: 0.137965 Jan 25 03:36:49.743005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 102/241] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:49 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 2041 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:36:50.396310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-42993819", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:50.451258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] validate_networks() for None {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:36:50.593283 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:50.594099 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:50.602531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:50.603188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:50.604254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:50.604915 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:50.759118 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:50.766561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c0b6eccc-d803-4de7-9038-b9cff031bbee tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.177653 Jan 25 03:36:50.770854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 103/242] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:50 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:50.775029 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:36:50.775533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1231075708", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "835e181b-635d-41dd-9269-42b6c17d0334"}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:50.775673 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:36:50.777330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:36:50.778503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:36:50.778930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:36:50.787996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:50.788454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:50.789317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:50.789760 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:50.808161 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Getting quotas for project f42d3702511c4fb08d050300e23d66a0. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:36:50.812326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Getting quotas for user 2a1023547698429c9c5dac76faf5cc91 and project f42d3702511c4fb08d050300e23d66a0. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:36:50.824159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:36:50.826712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:36:50.836276 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] validate_networks() for [('835e181b-635d-41dd-9269-42b6c17d0334', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:36:50.981954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3df166c-919b-48fa-b084-c90a0a6274b1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.590123 Jan 25 03:36:50.987661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 140/243] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:36:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:36:50.991582 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-edb47bc0-f656-4c6e-87ba-588468b944f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:50.993709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-edb47bc0-f656-4c6e-87ba-588468b944f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:51.001508 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edb47bc0-f656-4c6e-87ba-588468b944f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:51.002810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edb47bc0-f656-4c6e-87ba-588468b944f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:51.003874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edb47bc0-f656-4c6e-87ba-588468b944f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:51.004312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edb47bc0-f656-4c6e-87ba-588468b944f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:51.155603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-edb47bc0-f656-4c6e-87ba-588468b944f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 8229 microversion: 2.20 time: 0.171213 Jan 25 03:36:51.164015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 141/244] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:50 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 8229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:36:51.169887 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c69ba1c9-b292-499f-8711-d9935a68cdc5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:51.170592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c69ba1c9-b292-499f-8711-d9935a68cdc5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:51.224413 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c69ba1c9-b292-499f-8711-d9935a68cdc5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:51.231898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c69ba1c9-b292-499f-8711-d9935a68cdc5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1217 microversion: 2.1 time: 0.066519 Jan 25 03:36:51.234245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 142/245] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:51 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:51.234387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:36:51.234387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:36:51.234387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:36:51.234387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:36:51.234787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:36:51.243824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:51.244274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:51.245687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:51.246202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:51.263787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:36:51.269918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for user 66a4cd3a6bc441d8b1d4bfdd15a6402d and project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:36:51.288117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:36:51.290598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:36:51.455633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0f98a36e-4f40-42a5-9137-11f9b4218d27 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.683591 Jan 25 03:36:51.456290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 104/246] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:36:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:36:51.466508 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8237aea5-cbc6-4534-9278-dbb2720ea948 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:51.469315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8237aea5-cbc6-4534-9278-dbb2720ea948 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:51.523416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8237aea5-cbc6-4534-9278-dbb2720ea948 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:51.532576 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8237aea5-cbc6-4534-9278-dbb2720ea948 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1222 microversion: 2.1 time: 0.070135 Jan 25 03:36:51.533411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 143/247] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:51 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1222 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:51.790478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:51.792165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:51.799887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:51.800977 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:51.801795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:51.802246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:51.942303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:51.953051 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0f977b0d-2674-4a7d-a063-7f3e76a722ed tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.167880 Jan 25 03:36:51.953664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 105/248] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:51 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:52.167660 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fd7a612f-853a-4796-8dd5-6274d8559e29 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:52.168583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fd7a612f-853a-4796-8dd5-6274d8559e29 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:52.175528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd7a612f-853a-4796-8dd5-6274d8559e29 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.176335 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd7a612f-853a-4796-8dd5-6274d8559e29 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:52.177111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd7a612f-853a-4796-8dd5-6274d8559e29 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.177626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd7a612f-853a-4796-8dd5-6274d8559e29 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:52.250502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:52.251246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:52.257160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.257602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:52.258361 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.258788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:52.319425 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:52.327863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d678be06-96e4-40b4-8100-24e2d62dc54a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1221 microversion: 2.1 time: 0.080953 Jan 25 03:36:52.328149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fd7a612f-853a-4796-8dd5-6274d8559e29 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 13039 microversion: 2.20 time: 0.164889 Jan 25 03:36:52.328452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 106/249] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:52 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:52.331868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 144/250] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:52 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 13039 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:36:52.549641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:52.550251 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:52.556041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.556494 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:52.557889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.558450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:52.623778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:52.631339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e4d5ed26-ba84-40ae-9749-9fb7100c4b72 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1226 microversion: 2.1 time: 0.085344 Jan 25 03:36:52.631925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 107/251] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:52 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:52.718818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1918125239", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "5a6ed931-4b24-4be4-b671-86c474190d7e"}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:52.771314 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] validate_networks() for [('5a6ed931-4b24-4be4-b671-86c474190d7e', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:36:52.970220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:52.970821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:52.977979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.978641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:52.981747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:52.981747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.136613 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:36:53.137066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:36:53.137535 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:36:53.137962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:36:53.138370 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:36:53.142559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:53.147440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.148134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.148921 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.149437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.150252 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-11d160ee-b160-4477-8530-2d097e8ff2e4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.183753 Jan 25 03:36:53.151121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 108/252] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:52 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:53.167550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Getting quotas for project 9572dffe747a4371ace5d887368ca64b. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:36:53.171472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Getting quotas for user 3b9244d123024af08f3e75c09a5b586b and project 9572dffe747a4371ace5d887368ca64b. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:36:53.182706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:36:53.185301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:36:53.340685 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-732ee95c-647a-48a3-be56-ca9990dafe0a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:53.341739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-732ee95c-647a-48a3-be56-ca9990dafe0a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:53.347536 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-732ee95c-647a-48a3-be56-ca9990dafe0a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.347981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-732ee95c-647a-48a3-be56-ca9990dafe0a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.362490 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-732ee95c-647a-48a3-be56-ca9990dafe0a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.363017 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-732ee95c-647a-48a3-be56-ca9990dafe0a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.372846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8ecba273-6576-44ab-ad4b-df57c0ffed50 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.657915 Jan 25 03:36:53.373779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 145/253] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:36:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 25 03:36:53.400550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:53.400550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:53.400550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.400550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.400977 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.400977 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.461883 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:53.469449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-78b7a4a3-bc5e-40f7-8243-6d52ec1ad04c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1269 microversion: 2.1 time: 0.089408 Jan 25 03:36:53.470025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 146/254] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:53 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:53.474203 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-62dc7180-d1e5-480f-a6ed-dc680a02a91b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:53.474802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-62dc7180-d1e5-480f-a6ed-dc680a02a91b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:53.535282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-62dc7180-d1e5-480f-a6ed-dc680a02a91b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:53.543357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-62dc7180-d1e5-480f-a6ed-dc680a02a91b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1218 microversion: 2.1 time: 0.072293 Jan 25 03:36:53.543931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 147/255] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:53 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:53.559094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-732ee95c-647a-48a3-be56-ca9990dafe0a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 15839 microversion: 2.20 time: 0.220332 Jan 25 03:36:53.559094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 109/256] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:53 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 15839 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:36:53.648864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:53.649825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:53.661025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.661419 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.662231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:53.662683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:53.722856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:53.730777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-22d4d455-4923-4293-b0f3-762efb3cd608 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1274 microversion: 2.1 time: 0.085792 Jan 25 03:36:53.731407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 148/257] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:53 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:54.169488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:54.171618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:54.178905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.179507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.180387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.181309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.484283 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:54.487313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:54.488365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:54.492401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-000618f4-9825-4baf-bb89-857b03b5b6a2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.328298 Jan 25 03:36:54.508778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.508778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.508778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.508778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.509186 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 110/258] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:54 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:54.567159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fa496dc6-1880-42ab-beb6-5798436a542c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:54.568041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fa496dc6-1880-42ab-beb6-5798436a542c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:54.579547 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:54.589880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6cba1bbf-bbda-428b-9cff-c9a010f868ac tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1275 microversion: 2.1 time: 0.106504 Jan 25 03:36:54.596442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 149/259] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:54 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:54.601840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3670471e-9e3a-449a-bbf8-dd96f5c54a9e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:54.603230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3670471e-9e3a-449a-bbf8-dd96f5c54a9e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:54.622739 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3670471e-9e3a-449a-bbf8-dd96f5c54a9e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.623631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3670471e-9e3a-449a-bbf8-dd96f5c54a9e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.624428 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3670471e-9e3a-449a-bbf8-dd96f5c54a9e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.624870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3670471e-9e3a-449a-bbf8-dd96f5c54a9e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.676501 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fa496dc6-1880-42ab-beb6-5798436a542c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:54.684576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fa496dc6-1880-42ab-beb6-5798436a542c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1218 microversion: 2.1 time: 0.121261 Jan 25 03:36:54.685147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 111/260] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:54 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:54.753026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:54.753656 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:54.760413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.764360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3670471e-9e3a-449a-bbf8-dd96f5c54a9e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 17498 microversion: 2.20 time: 0.166028 Jan 25 03:36:54.765796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 150/261] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:54 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 17498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:36:54.766357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.767524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:54.767968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:54.854839 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:54.862548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-06d5d7a9-9a44-44c3-981a-cc49daa16ce8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1292 microversion: 2.1 time: 0.113610 Jan 25 03:36:54.863516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 112/262] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:54 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1292 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:55.511687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:55.512229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:55.518727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.519490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.520280 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.520718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.625621 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:55.626953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:55.647607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.648162 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.650209 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.651810 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.711205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:55.721395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b2d52d10-b790-40dd-a2cb-81b63a4d0c52 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.213996 Jan 25 03:36:55.722741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 151/263] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:55 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:55.732905 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:55.733875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:55.740362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.740812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.741586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.742337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.751576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:55.765158 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fb1a053b-fef1-45d2-bd84-eac567dea4dc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1275 microversion: 2.1 time: 0.143291 Jan 25 03:36:55.766300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 113/264] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:55 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:55.786423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6bd52641-d84c-41d7-a387-73eddacce343 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:55.792167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6bd52641-d84c-41d7-a387-73eddacce343 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:55.795548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6bd52641-d84c-41d7-a387-73eddacce343 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.796035 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6bd52641-d84c-41d7-a387-73eddacce343 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.796893 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6bd52641-d84c-41d7-a387-73eddacce343 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.797284 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6bd52641-d84c-41d7-a387-73eddacce343 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.810323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:55.818927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-61b5cb4f-2ce1-4bcd-9cdd-da9062f44cae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1270 microversion: 2.1 time: 0.094874 Jan 25 03:36:55.819533 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 152/265] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:55 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:55.878768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:55.879407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:55.889589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.891100 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.892331 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:55.894412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:55.974962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6bd52641-d84c-41d7-a387-73eddacce343 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 17861 microversion: 2.20 time: 0.195671 Jan 25 03:36:55.979906 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 114/266] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:55 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 17861 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:36:56.059274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:56.068572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-18230b0a-a890-4631-bbf8-a8c7d42bf891 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.193263 Jan 25 03:36:56.069223 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 153/267] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:55 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:56.742074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:56.743105 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:56.750467 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:56.751226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:56.752221 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:56.752858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:56.782496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:56.783405 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:56.790690 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:56.791707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:56.792678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:56.793189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:56.968492 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:56.981038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c5db9318-88a7-4186-a1b9-f3c806c54071 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.202157 Jan 25 03:36:56.981766 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 154/268] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:56 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:56.988997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:56.991232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:57.000822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.001558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.002053 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.002491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.098317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:57.107672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-68297e2c-cdc5-42b6-8d49-0a28dd318b28 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1276 microversion: 2.1 time: 0.123955 Jan 25 03:36:57.108607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 155/269] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:56 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:57.114281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7fb937dd-c511-49da-a28a-bd0f9de7bf82 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:57.116359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7fb937dd-c511-49da-a28a-bd0f9de7bf82 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:57.126732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7fb937dd-c511-49da-a28a-bd0f9de7bf82 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.126732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7fb937dd-c511-49da-a28a-bd0f9de7bf82 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.127690 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7fb937dd-c511-49da-a28a-bd0f9de7bf82 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.127893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7fb937dd-c511-49da-a28a-bd0f9de7bf82 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.256135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7fb937dd-c511-49da-a28a-bd0f9de7bf82 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 19399 microversion: 2.20 time: 0.145216 Jan 25 03:36:57.257764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 156/270] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:57 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 19399 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:36:57.272929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:57.274715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:57.286113 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.287128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.288896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.289552 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.290239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:57.304173 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-07590a77-9096-44a3-b10c-11b156bf589e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.567585 Jan 25 03:36:57.304985 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 115/271] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:56 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:57.470215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:57.478449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4d45dac8-4ad8-4bc7-bc4a-35f5c3b83595 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.218656 Jan 25 03:36:57.481425 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 157/272] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:57 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:57.648152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-47ec304e-6454-4f72-a9ed-64d909600738 req-f6c30a63-b1af-4bca-9f39-2e2ca2c66c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff", "tag": "1c678aaa-9fbd-45b4-9a6f-9d3633b78121"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:57.650150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:57.650150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:36:57.680439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-47ec304e-6454-4f72-a9ed-64d909600738 req-f6c30a63-b1af-4bca-9f39-2e2ca2c66c98 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.681139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-47ec304e-6454-4f72-a9ed-64d909600738 req-f6c30a63-b1af-4bca-9f39-2e2ca2c66c98 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.703383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-47ec304e-6454-4f72-a9ed-64d909600738 req-f6c30a63-b1af-4bca-9f39-2e2ca2c66c98 service nova] Creating event network-changed:1c678aaa-9fbd-45b4-9a6f-9d3633b78121 for instance bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff on hv-cinder-81901 Jan 25 03:36:57.715564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-47ec304e-6454-4f72-a9ed-64d909600738 req-f6c30a63-b1af-4bca-9f39-2e2ca2c66c98 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076226 Jan 25 03:36:57.716992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 116/273] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:36:57.947208 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:57.947856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:57.960818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.961592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.974825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:57.975717 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:57.999434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:58.000133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:58.015177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:36:58.019149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.020855 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.021918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.022577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.386335 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6441eb74-ec04-4e78-ba45-10cee5d7f875 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "DELETE /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 204 len: 0 microversion: 2.1 time: 0.442608 Jan 25 03:36:58.386940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 158/274] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:36:57 2022] DELETE /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:36:58.392115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:58.398578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:58.399714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.400171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.401538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.402154 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.470317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:58.478675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1af9d19e-f2ba-4571-ba96-e5d084c74c80 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1276 microversion: 2.1 time: 0.090330 Jan 25 03:36:58.479562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 159/275] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:58 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:58.493842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b0781df8-4727-4364-a432-3d6b88bba935 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:58.495487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b0781df8-4727-4364-a432-3d6b88bba935 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:58.502732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0781df8-4727-4364-a432-3d6b88bba935 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.503511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0781df8-4727-4364-a432-3d6b88bba935 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.504455 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0781df8-4727-4364-a432-3d6b88bba935 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.505046 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0781df8-4727-4364-a432-3d6b88bba935 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.637832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b0781df8-4727-4364-a432-3d6b88bba935 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 21935 microversion: 2.20 time: 0.156702 Jan 25 03:36:58.643127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 160/276] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:58 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 21935 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:36:58.651140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:58.652532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:58.660356 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.665065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.665065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.665065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.838949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:58.847294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e1b40a62-2e91-4e08-84bf-b402efb0cb7c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.202161 Jan 25 03:36:58.848009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 161/277] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:58 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:58.853239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:58.854486 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:58.861075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.861774 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.862658 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.863248 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.904669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:58.917846 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-253006bb-4ee5-487b-a339-f8230112665d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.923373 Jan 25 03:36:58.918537 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 117/278] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:57 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:36:58.935235 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:58.936000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:58.942317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.942769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:58.943638 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:58.944075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.029881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:59.040424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c2b808cc-b1aa-4b27-8390-71acff7ffe32 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1558 microversion: 2.1 time: 0.191008 Jan 25 03:36:59.047112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 162/279] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:58 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:59.319194 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:59.328044 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-aaa22d21-5364-436e-afdd-5fbe307af5aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.407748 Jan 25 03:36:59.329148 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 118/280] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:58 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:59.496636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:59.497353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:59.503856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.504383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.505235 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.505745 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.650944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-57db1cea-0f67-4bb6-b930-b72fea6b016f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:59.652108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-57db1cea-0f67-4bb6-b930-b72fea6b016f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:59.658935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:36:59.659966 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57db1cea-0f67-4bb6-b930-b72fea6b016f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.659966 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57db1cea-0f67-4bb6-b930-b72fea6b016f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.660712 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57db1cea-0f67-4bb6-b930-b72fea6b016f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.661670 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57db1cea-0f67-4bb6-b930-b72fea6b016f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.677593 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3eafea92-0e63-4e18-9a76-c3942e8f4b5d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.181778 Jan 25 03:36:59.679318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 163/281] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:59 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:36:59.786959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-d9a5f753-7ec4-4cc3-91be-4d69204845f2 req-64ecd296-0aed-4ee3-8d3f-c8f253468fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7a93cbd-7b1b-4e5a-99f6-e25f560df158", "tag": "03218c00-6b39-4ae7-8a61-39eccba27ba4"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:36:59.788872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:36:59.788872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:36:59.796566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-d9a5f753-7ec4-4cc3-91be-4d69204845f2 req-64ecd296-0aed-4ee3-8d3f-c8f253468fc9 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.797062 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-d9a5f753-7ec4-4cc3-91be-4d69204845f2 req-64ecd296-0aed-4ee3-8d3f-c8f253468fc9 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.808337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-d9a5f753-7ec4-4cc3-91be-4d69204845f2 req-64ecd296-0aed-4ee3-8d3f-c8f253468fc9 service nova] Creating event network-changed:03218c00-6b39-4ae7-8a61-39eccba27ba4 for instance b7a93cbd-7b1b-4e5a-99f6-e25f560df158 on hv-cinder-81901 Jan 25 03:36:59.818427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-57db1cea-0f67-4bb6-b930-b72fea6b016f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 22769 microversion: 2.20 time: 0.162370 Jan 25 03:36:59.818427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 119/282] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:36:59 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 22769 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:36:59.818647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-d9a5f753-7ec4-4cc3-91be-4d69204845f2 req-64ecd296-0aed-4ee3-8d3f-c8f253468fc9 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031043 Jan 25 03:36:59.818647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 164/283] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:36:59.866368 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:59.867438 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:59.876030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.876842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.881563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.881563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.936837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:36:59.937539 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:36:59.943539 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.944606 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:36:59.945409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:36:59.945846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.093087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:00.100592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-70aeb8be-464e-4f93-9897-32a833f4bfab tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.167913 Jan 25 03:37:00.105605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 165/284] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:59 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:00.108132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:00.108730 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:00.115125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.115584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.116367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.116802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.256564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:00.276707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-baf26a6e-ad7c-438c-9303-1180d390fc0d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.410169 Jan 25 03:37:00.276707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 120/285] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:36:59 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:00.277219 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:00.287044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-48c89f4d-b0d1-47d2-b773-07fde58e5592 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1558 microversion: 2.1 time: 0.184705 Jan 25 03:37:00.291659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 166/286] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:00 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:00.344710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:00.345407 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:00.355734 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.356257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.357127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.357666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.680453 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:00.688583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e29424d9-b7b9-447b-a2e0-2ad460759fe3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.347461 Jan 25 03:37:00.689429 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 121/287] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:00 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:00.695312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:00.696202 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:00.703280 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.703732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.704552 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.704991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.820686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-42d9c74f-d96e-4bf8-9006-a7b232e55345 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:00.821635 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-42d9c74f-d96e-4bf8-9006-a7b232e55345 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:00.828820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42d9c74f-d96e-4bf8-9006-a7b232e55345 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.829274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42d9c74f-d96e-4bf8-9006-a7b232e55345 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.830062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42d9c74f-d96e-4bf8-9006-a7b232e55345 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:00.830680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42d9c74f-d96e-4bf8-9006-a7b232e55345 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:00.850823 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:00.859893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-894b859f-00c7-4fe1-afaf-89256f232c4d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.168444 Jan 25 03:37:00.860477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 167/288] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:00 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:01.117820 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:01.118440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:01.125023 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.125482 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.126269 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.126708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.175081 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-42d9c74f-d96e-4bf8-9006-a7b232e55345 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 23797 microversion: 2.20 time: 0.358042 Jan 25 03:37:01.178864 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 122/289] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:00 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 23797 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:01.263192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:01.270642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-55d5e996-15bc-4ca8-a3a4-124079e05f7f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.156621 Jan 25 03:37:01.271242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 168/290] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:01 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:01.292117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:01.292905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:01.300366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.300968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.301989 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.302619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.317718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:01.317718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:01.335931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.336131 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.337128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.337663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.506991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:01.515926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c76a4c03-89c6-4941-a158-511f4f588102 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1558 microversion: 2.1 time: 0.214565 Jan 25 03:37:01.517438 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 169/291] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:01 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:01.550772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:01.558289 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f2f6da92-4f84-401a-98ea-b9f1005f362a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.270380 Jan 25 03:37:01.558871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 123/292] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:01 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:01.705669 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:01.706592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:01.714581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.715287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.716098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.716690 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.862113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-6e8157d9-1484-474d-bd8e-d97732bf2039 req-ce59af37-2bb6-4888-b4fc-e59767f90e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca6ff2e-464f-45a9-a5ba-58ce987262ed", "tag": "a4e3c785-fdb7-4f1f-bfdb-ec65f69514eb"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:01.863728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:01.863728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:37:01.865497 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:01.872278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-6e8157d9-1484-474d-bd8e-d97732bf2039 req-ce59af37-2bb6-4888-b4fc-e59767f90e26 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.872817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-6e8157d9-1484-474d-bd8e-d97732bf2039 req-ce59af37-2bb6-4888-b4fc-e59767f90e26 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.875941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ca588967-b495-434d-a297-9e6bd4061f6f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.173944 Jan 25 03:37:01.887182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 170/293] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:01 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:01.887182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:01.887182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:01.889757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.890221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.891013 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:01.891613 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:01.908387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-6e8157d9-1484-474d-bd8e-d97732bf2039 req-ce59af37-2bb6-4888-b4fc-e59767f90e26 service nova] Creating event network-changed:a4e3c785-fdb7-4f1f-bfdb-ec65f69514eb for instance 0ca6ff2e-464f-45a9-a5ba-58ce987262ed on hv-cinder-81901 Jan 25 03:37:01.914426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-6e8157d9-1484-474d-bd8e-d97732bf2039 req-ce59af37-2bb6-4888-b4fc-e59767f90e26 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056106 Jan 25 03:37:01.916740 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 124/294] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:02.033874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:02.043133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c87fd602-a8f4-421f-a806-e492e5cfa953 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.165592 Jan 25 03:37:02.043919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 171/295] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:01 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:02.187085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0ceccbb9-ffda-4aed-8ccd-7375a1f727f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:02.188125 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0ceccbb9-ffda-4aed-8ccd-7375a1f727f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:02.197469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0ceccbb9-ffda-4aed-8ccd-7375a1f727f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.197469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0ceccbb9-ffda-4aed-8ccd-7375a1f727f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.197469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0ceccbb9-ffda-4aed-8ccd-7375a1f727f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.197469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0ceccbb9-ffda-4aed-8ccd-7375a1f727f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.287855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:02.288470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:02.295003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.295517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.296287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.296765 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.441193 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:02.449529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-179ef52e-c1d7-4b1c-90ff-e35331d70e3a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.165433 Jan 25 03:37:02.450099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 172/296] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:02 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:02.533168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:02.533775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:02.539512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.539968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.540738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.541227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.670706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:02.678481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7ca977ce-0fb1-4250-9e66-797772c24d37 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1558 microversion: 2.1 time: 0.148820 Jan 25 03:37:02.679076 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 173/297] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:02 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:02.684177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:02.684782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:02.690137 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.690533 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.691337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.691781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.825370 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:02.830057 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f9f83f9a-e187-4734-9822-93feb7523607 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.150060 Jan 25 03:37:02.830622 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 174/298] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:02 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:02.892322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:02.892922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:02.898863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.899350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:02.900684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:02.901132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.042737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:03.044502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0ceccbb9-ffda-4aed-8ccd-7375a1f727f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 24695 microversion: 2.20 time: 0.861500 Jan 25 03:37:03.045887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 125/299] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:02 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 24695 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:03.051284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e33df4c5-3880-47c5-a02c-6d02499f10d0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.162489 Jan 25 03:37:03.059557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 175/300] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:02 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:03.078527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:03.079257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:03.086359 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.086803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.088363 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.088802 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.455373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:03.463509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-780ab35d-c706-466f-a456-3febd6bfad5e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.401314 Jan 25 03:37:03.464540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 126/301] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:03 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:03.467003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:03.468073 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:03.474217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.474677 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.475518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.475958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.611356 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:03.620070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3ad8459-8e2a-4681-a430-adc46f6c3d00 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.157442 Jan 25 03:37:03.629440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 176/302] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:03 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:03.696250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:03.696858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:03.704970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.705423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.706274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.706713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.846663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:03.847301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:03.854131 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.854599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.855428 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.855865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.934966 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:03.943343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-439492ef-e685-4495-a3d3-471827567a97 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1558 microversion: 2.1 time: 0.251204 Jan 25 03:37:03.944023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 127/303] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:03 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1558 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:03.949885 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-65113793-54ff-47eb-870d-0f36bd366c32 req-e08552c3-ee29-448b-a6ce-59cf033a0c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182d19da-cad7-4773-bd15-67d9285d2c1a", "name": "network-vif-deleted", "tag": "1a2cf8cb-4a21-4b74-ab28-8d2bae03f13c"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:03.951556 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:03.951556 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:37:03.967356 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-65113793-54ff-47eb-870d-0f36bd366c32 req-e08552c3-ee29-448b-a6ce-59cf033a0c81 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:03.967892 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-65113793-54ff-47eb-870d-0f36bd366c32 req-e08552c3-ee29-448b-a6ce-59cf033a0c81 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:03.980573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-65113793-54ff-47eb-870d-0f36bd366c32 req-e08552c3-ee29-448b-a6ce-59cf033a0c81 service nova] Creating event network-vif-deleted:1a2cf8cb-4a21-4b74-ab28-8d2bae03f13c for instance 182d19da-cad7-4773-bd15-67d9285d2c1a on hv-cinder-81901 Jan 25 03:37:03.985642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-65113793-54ff-47eb-870d-0f36bd366c32 req-e08552c3-ee29-448b-a6ce-59cf033a0c81 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040438 Jan 25 03:37:03.986256 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 128/304] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:04.023659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:04.031803 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-89b94f1c-5574-4cfe-8a81-a76cd0c246c7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1526 microversion: 2.1 time: 0.188854 Jan 25 03:37:04.032372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 177/305] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:03 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1526 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:04.057487 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b25a2e0e-c4e5-4704-a7fc-f3cbdf3bb959 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:04.058505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b25a2e0e-c4e5-4704-a7fc-f3cbdf3bb959 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:04.066699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b25a2e0e-c4e5-4704-a7fc-f3cbdf3bb959 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.067263 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b25a2e0e-c4e5-4704-a7fc-f3cbdf3bb959 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.068048 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b25a2e0e-c4e5-4704-a7fc-f3cbdf3bb959 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.068604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:04.076780 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b25a2e0e-c4e5-4704-a7fc-f3cbdf3bb959 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.076926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:04.076926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.076926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.077357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.077796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.211273 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:04.219866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7bd32c1f-5a0c-45b9-94ae-e76efeb35cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.155027 Jan 25 03:37:04.220447 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 178/306] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:04 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:04.391843 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b25a2e0e-c4e5-4704-a7fc-f3cbdf3bb959 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 25596 microversion: 2.20 time: 0.338705 Jan 25 03:37:04.392601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 129/307] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:04 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 25596 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:04.480096 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:04.481010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:04.487022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.487517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.488350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.488823 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.630932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:04.637368 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:04.638074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:04.638764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1894f93e-a055-489b-9168-dec565a74a34 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.162318 Jan 25 03:37:04.651676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.651676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.651676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.651676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.652698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 179/308] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:04 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:04.820551 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:04.828622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-63ab27b0-24e3-4719-8bc9-fbc90b7c1804 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.195859 Jan 25 03:37:04.829195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 130/309] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:04 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:04.960709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:04.961313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:04.968419 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.968869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:04.969643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:04.970080 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.001870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.002241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.002699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lazy-loading 'fault' on Instance uuid 182d19da-cad7-4773-bd15-67d9285d2c1a {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:05.049867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:05.050608 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:05.055312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:05.057317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.058539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.059383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.060152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.064878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0e43fbf4-8655-4b57-b9c3-bb2758d62197 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1355 microversion: 2.1 time: 0.107113 Jan 25 03:37:05.064878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 180/310] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:04 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:05.200828 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:05.211232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-447a6ffa-6b2c-41ae-8909-0cb05621fba8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1506 microversion: 2.1 time: 0.164945 Jan 25 03:37:05.212025 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 131/311] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:05 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:05.227503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:05.228108 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:05.234685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.235163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.235944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.236374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.237849 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:05.238465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:05.244637 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.245084 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.246652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.247339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.389246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:05.391490 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:05.396933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f9daf97f-2749-4f07-93df-96187bf1777e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1521 microversion: 2.1 time: 0.172942 Jan 25 03:37:05.397509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 181/312] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:05 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:05.398795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d7cbd762-a981-4d3e-9720-2479263a753c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.165271 Jan 25 03:37:05.399644 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 132/313] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:05 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:05.404492 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-563a06df-766f-48a2-91b9-f8a6cae0f5a4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:05.405460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-563a06df-766f-48a2-91b9-f8a6cae0f5a4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:05.411636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-563a06df-766f-48a2-91b9-f8a6cae0f5a4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.412099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-563a06df-766f-48a2-91b9-f8a6cae0f5a4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.412888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-563a06df-766f-48a2-91b9-f8a6cae0f5a4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.413333 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-563a06df-766f-48a2-91b9-f8a6cae0f5a4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.585872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-563a06df-766f-48a2-91b9-f8a6cae0f5a4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 26449 microversion: 2.20 time: 0.185024 Jan 25 03:37:05.586970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 182/314] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:05 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 26449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:05.656087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:05.656954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:05.662807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.663303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.664062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.664499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.796807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:05.804116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9aa87af5-27f1-4297-b731-d8b1795322ff tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.152071 Jan 25 03:37:05.804843 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 133/315] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:05 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:05.845451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:05.846241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:05.853186 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.853643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:05.854434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:05.855410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.000351 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:06.007712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a8031df4-e154-424c-9340-3b4be7af25d8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.166503 Jan 25 03:37:06.008270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 183/316] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:05 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:06.082056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:06.082674 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:06.088983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.089458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.090221 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.090648 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.121179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.121560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.122002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lazy-loading 'fault' on Instance uuid 182d19da-cad7-4773-bd15-67d9285d2c1a {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:06.163229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:06.171740 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7ed1dfe5-c296-44e1-9fcb-a968065f1b2e tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1355 microversion: 2.1 time: 0.093228 Jan 25 03:37:06.172235 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 134/317] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:06 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1355 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:06.419291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:06.419898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:06.426399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.426846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.427642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.428076 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.554712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:06.562573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-893052db-ee24-4ed5-8b2a-049651fd13d8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.147005 Jan 25 03:37:06.563166 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 184/318] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:06 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:06.597264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6e407e7f-ffb1-40e2-bccb-21f3bfd9d9c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:06.598293 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6e407e7f-ffb1-40e2-bccb-21f3bfd9d9c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:06.604118 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e407e7f-ffb1-40e2-bccb-21f3bfd9d9c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.604572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e407e7f-ffb1-40e2-bccb-21f3bfd9d9c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.605872 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e407e7f-ffb1-40e2-bccb-21f3bfd9d9c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.606305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e407e7f-ffb1-40e2-bccb-21f3bfd9d9c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.821248 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:06.821868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:06.829035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.829491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.830268 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:06.830711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:06.963097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:06.971034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1250477c-bdca-4e2c-a89d-b4ed734a2925 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.153444 Jan 25 03:37:06.971610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 185/319] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:06 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:07.024452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:07.025064 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:07.030990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.031477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.032287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.032732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.189152 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:07.197470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-35d7c27b-8eb3-4f0c-bcc8-14e72a494f04 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.176470 Jan 25 03:37:07.198320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 186/320] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:07 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:07.202583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:07.203215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:07.208671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.209126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.209901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.210343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.241953 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.242405 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.242850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lazy-loading 'fault' on Instance uuid 182d19da-cad7-4773-bd15-67d9285d2c1a {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:07.279766 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:07.287453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-706a23ce-65f0-4429-8cd3-9a975c8e89d6 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1355 microversion: 2.1 time: 0.088163 Jan 25 03:37:07.288027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 187/321] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:07 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1355 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:07.578879 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:07.579529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:07.585720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.586174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.586945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.587411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.717339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:07.724467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2f2b4a2a-914c-430c-9811-c360fc4bacc2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.149252 Jan 25 03:37:07.725030 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 188/322] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:07 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:07.987776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:07.988477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:07.994247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.994708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:07.996805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:07.996805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.128811 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:08.136148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d847df87-5ce5-4a21-a799-b2410e95b038 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.152102 Jan 25 03:37:08.136711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 189/323] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:07 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:08.213444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:08.214088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:08.219933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:08.220392 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.221174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:08.221621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.345890 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:08.353176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9d2a1f02-a145-48fd-9eb7-4ca222ba7c9d tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.143415 Jan 25 03:37:08.353746 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 190/324] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:08 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:08.358707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:08.359336 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:08.364912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:08.365365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.366144 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:08.366585 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.396545 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:08.396998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.397479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lazy-loading 'fault' on Instance uuid 182d19da-cad7-4773-bd15-67d9285d2c1a {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:08.438498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:08.446133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-688457d3-3b25-4ed2-8519-8109ceea9d07 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1355 microversion: 2.1 time: 0.091443 Jan 25 03:37:08.446703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 191/325] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:08 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1355 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:08.740344 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:08.740988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:08.748148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:08.748600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.749369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:08.749805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:08.877004 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:08.884197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d76dc4bb-58d7-4bbd-ac04-bb60190bb350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.147458 Jan 25 03:37:08.884763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 192/326] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:08 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:09.152795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:09.153398 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:09.159163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.159611 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.160391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.160819 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.293693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:09.301160 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-49c0c76f-e3b7-41ed-8226-9d7a6688bb40 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.152184 Jan 25 03:37:09.301729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 193/327] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:09 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:09.370392 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:09.371359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:09.377190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.377714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.378558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.379075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.513653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:09.521137 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-23014d18-e941-48d0-88b9-dea506e17ec1 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.154428 Jan 25 03:37:09.522383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 194/328] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:09 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:09.526987 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:09.527990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:09.537759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.538212 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.539002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.539689 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.575645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.576121 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.579080 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lazy-loading 'fault' on Instance uuid 182d19da-cad7-4773-bd15-67d9285d2c1a {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:09.621736 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '420b2ab1a77943a59c942d3837545fa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b8fc6cf53240e292dae12d36286f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:09.629452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5010b7b6-a9f8-46dc-9187-edb92ffbce75 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 200 len: 1355 microversion: 2.1 time: 0.105994 Jan 25 03:37:09.630022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 195/329] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:09 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 1355 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:09.901095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:09.902348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:09.909131 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.909590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:09.910400 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:09.910843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.054081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:10.061873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-86c2d79d-c193-41b4-9a61-c3b669525966 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.164495 Jan 25 03:37:10.062435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 196/330] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:09 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:10.317545 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:10.318128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:10.324736 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.325189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.325975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.326418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.455098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:10.462665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f468c6cb-d165-4efa-8d5a-4b14fe2c5637 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.148760 Jan 25 03:37:10.463282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 197/331] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:10 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:10.541874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:10.543038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:10.548901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.549357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.550133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.550573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.687522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:10.695027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-01ccba23-9499-427b-af80-545d3af7af68 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.156809 Jan 25 03:37:10.695633 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 198/332] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:10 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:10.700793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:10.701401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:10.707093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.707559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.708337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.708780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.723003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] HTTP exception thrown: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. Jan 25 03:37:10.723631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Returning 404 to user: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:10.724462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0be10081-ad55-44bc-a31f-cd0e0d55848f tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 404 len: 111 microversion: 2.1 time: 0.027869 Jan 25 03:37:10.725008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 199/333] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:10 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:37:10.827756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:10.828748 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:10.834578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.835031 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.835852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:10.836345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:10.848852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] HTTP exception thrown: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. Jan 25 03:37:10.849443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Returning 404 to user: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:10.850263 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f48826e7-bd61-470a-ae71-0209be846687 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028681 Jan 25 03:37:10.850802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 200/334] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:37:10 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 25 03:37:11.002823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6e407e7f-ffb1-40e2-bccb-21f3bfd9d9c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 27760 microversion: 2.20 time: 4.409112 Jan 25 03:37:11.003511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 135/335] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:06 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 27760 bytes in 4411 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:11.078461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:11.079089 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:11.085400 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:11.085849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:11.086676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:11.087081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:11.222498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:11.229741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1d0437a1-e655-472e-a57a-001005c81a51 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.154745 Jan 25 03:37:11.230377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 201/336] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:11 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:11.482628 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:11.483435 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:11.490165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:11.490605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:11.491411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:11.491841 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:11.625046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:11.632273 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7a1122d3-93e4-4902-82e5-e18af3187e6e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.154588 Jan 25 03:37:11.632845 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 136/337] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:11 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:11.712539 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:11.713143 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:11.719524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:11.719973 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:11.720753 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:11.721188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:11.849598 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:11.857407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-68c77706-7f22-4a09-bace-02ab97bf5d87 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.148406 Jan 25 03:37:11.857974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 202/338] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:11 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:12.015310 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d5b1ed2b-46fb-4f87-b491-27d5776f34d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:12.016219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d5b1ed2b-46fb-4f87-b491-27d5776f34d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:12.022572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d5b1ed2b-46fb-4f87-b491-27d5776f34d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.023028 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d5b1ed2b-46fb-4f87-b491-27d5776f34d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.023846 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d5b1ed2b-46fb-4f87-b491-27d5776f34d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.024289 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d5b1ed2b-46fb-4f87-b491-27d5776f34d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.123634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d5b1ed2b-46fb-4f87-b491-27d5776f34d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 27891 microversion: 2.20 time: 0.112352 Jan 25 03:37:12.125013 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 137/339] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:12 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 27891 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:12.246785 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:12.247438 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:12.253881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.254341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.255151 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.255597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.383276 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:12.384342 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:12.388500 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:12.392047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.392495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.393282 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.393761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.395847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b600f002-5942-48f0-b212-d0eab9557a89 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.153274 Jan 25 03:37:12.396414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 203/340] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:12 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:12.418681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lazy-loading 'flavor' on Instance uuid 17d82b81-05dd-4075-8d84-577551c2a689 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:12.649584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:12.650116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:12.656494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.656945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.657747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.658187 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.666839 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9615ab2c-7c23-48dc-a42e-00c89b223150 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action" status: 200 len: 32 microversion: 2.1 time: 0.287872 Jan 25 03:37:12.668077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 138/341] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:37:12 2022] POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 25 03:37:12.677304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:12.678220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:12.685140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.685824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.686846 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.687304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.810123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:12.823179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a831ac30-9c45-41a8-ab44-7835e9faf52e tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.175130 Jan 25 03:37:12.823179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 204/342] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:12 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:12.866662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:12.875464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-549ac14b-8705-4879-ad3c-7f730e5d8a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.202018 Jan 25 03:37:12.876046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 139/343] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:12 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:12.880633 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:12.881321 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:12.888603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.889145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:12.890003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:12.890513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.036058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:13.044477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7c6bdebf-32a4-4729-9688-66d4f656f4be tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.168658 Jan 25 03:37:13.045310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 205/344] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:12 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:13.134987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-79d28ef6-5256-4dfc-84b0-2ca7ac1c23ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:13.136766 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-79d28ef6-5256-4dfc-84b0-2ca7ac1c23ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:13.144382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79d28ef6-5256-4dfc-84b0-2ca7ac1c23ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.144830 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79d28ef6-5256-4dfc-84b0-2ca7ac1c23ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.145610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79d28ef6-5256-4dfc-84b0-2ca7ac1c23ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.146080 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79d28ef6-5256-4dfc-84b0-2ca7ac1c23ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.229109 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:13.230187 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:13.236679 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.237139 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.237932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.238374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.256047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] HTTP exception thrown: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. Jan 25 03:37:13.256047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Returning 404 to user: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:13.256047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-66703bd1-d841-4052-bdb9-a8ddc9ed3509 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "DELETE /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 404 len: 111 microversion: 2.1 time: 0.028605 Jan 25 03:37:13.256047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 206/345] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:37:13 2022] DELETE /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:37:13.261973 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:13.262695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] [instance: 182d19da-cad7-4773-bd15-67d9285d2c1a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:13.268446 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.269012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.269859 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.270374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.284437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] HTTP exception thrown: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. Jan 25 03:37:13.285025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] Returning 404 to user: Instance 182d19da-cad7-4773-bd15-67d9285d2c1a could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:13.285957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-667e5a4e-38b4-48b9-a1e6-d6b8bb82ce96 tempest-DeleteServersTestJSON-1150454637 tempest-DeleteServersTestJSON-1150454637-project] 10.222.0.115 "GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a" status: 404 len: 111 microversion: 2.1 time: 0.027333 Jan 25 03:37:13.286496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 207/346] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:13 2022] GET /compute/v2.1/servers/182d19da-cad7-4773-bd15-67d9285d2c1a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 25 03:37:13.413302 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:13.413918 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:13.415609 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-79d28ef6-5256-4dfc-84b0-2ca7ac1c23ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28069 microversion: 2.20 time: 0.283974 Jan 25 03:37:13.418222 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 140/347] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:13 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28069 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:13.420000 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.420450 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.421232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.421665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.566703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:13.575205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-95af616e-f6df-4f7a-983a-5152004a21df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.165536 Jan 25 03:37:13.575781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 208/348] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:13 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:13.838808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:13.840095 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:13.846856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.847348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.848209 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.850964 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.891736 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:13.892353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:13.898247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.898693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.899543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:13.899987 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:13.984611 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:13.994768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bc73ac16-1855-4daf-ae3e-029443e5d240 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.159946 Jan 25 03:37:13.995836 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 141/349] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:13 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:14.055041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:14.063245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-872dcaf7-f256-489d-a640-b9291359a3df tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.175231 Jan 25 03:37:14.064091 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 209/350] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:13 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:14.065081 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:14.065892 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:14.072440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:14.073161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:14.074705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:14.075128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:14.204191 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:14.211532 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cafc5f6d-931d-434e-830a-7bba88376f40 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.153378 Jan 25 03:37:14.212034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 142/351] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:14 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:14.427869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b9f1b490-c6de-4648-92cd-f9f76b6654a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:14.428847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b9f1b490-c6de-4648-92cd-f9f76b6654a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:14.435885 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9f1b490-c6de-4648-92cd-f9f76b6654a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:14.436338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9f1b490-c6de-4648-92cd-f9f76b6654a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:14.437103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9f1b490-c6de-4648-92cd-f9f76b6654a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:14.437531 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9f1b490-c6de-4648-92cd-f9f76b6654a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:14.590494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b9f1b490-c6de-4648-92cd-f9f76b6654a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.165724 Jan 25 03:37:14.591973 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 210/352] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:14 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:14.592521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:14.593135 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:14.600278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:14.600738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:14.605503 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:14.605503 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:14.923962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-a7ecc70b-4595-4711-b3bd-001d492555c4 req-5a9df6ff-4ea3-48d7-8e95-2c571b42905f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff", "name": "network-vif-plugged", "status": "completed", "tag": "1c678aaa-9fbd-45b4-9a6f-9d3633b78121"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:14.928274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:14.928274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:37:14.935583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a7ecc70b-4595-4711-b3bd-001d492555c4 req-5a9df6ff-4ea3-48d7-8e95-2c571b42905f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:14.936026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a7ecc70b-4595-4711-b3bd-001d492555c4 req-5a9df6ff-4ea3-48d7-8e95-2c571b42905f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:14.947934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-a7ecc70b-4595-4711-b3bd-001d492555c4 req-5a9df6ff-4ea3-48d7-8e95-2c571b42905f service nova] Creating event network-vif-plugged:1c678aaa-9fbd-45b4-9a6f-9d3633b78121 for instance bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff on hv-cinder-81901 Jan 25 03:37:14.954080 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-a7ecc70b-4595-4711-b3bd-001d492555c4 req-5a9df6ff-4ea3-48d7-8e95-2c571b42905f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035301 Jan 25 03:37:14.955241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 211/353] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:37:14.958574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:14.966540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-82bb407f-f892-498a-a7d9-36cdc7f52eee tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.377890 Jan 25 03:37:14.967228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 143/354] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:14 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:15.013457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:15.014339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:15.025655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.025655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.025857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.026276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.081205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:15.082000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:15.091723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.092389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.093341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.093960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.186374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:15.194605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4c9455e9-f1f2-4460-964f-def6ebed2589 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.186707 Jan 25 03:37:15.207287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 212/355] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:15 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:15.233495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:15.240112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:15.245329 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.246513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.247591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.248230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.256323 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:15.259423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4384dd81-17a5-44f9-9463-3ea8f280aeb1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.182300 Jan 25 03:37:15.270657 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 144/356] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:15 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:15.434784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:15.439170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a775a3b8-b1ab-4cc5-8638-d68051f40763 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.214105 Jan 25 03:37:15.440201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 213/357] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:15 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:15.601781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bedc0023-ac89-4047-b83a-525559eb0729 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:15.602769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bedc0023-ac89-4047-b83a-525559eb0729 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:15.609266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bedc0023-ac89-4047-b83a-525559eb0729 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.609705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bedc0023-ac89-4047-b83a-525559eb0729 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.610465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bedc0023-ac89-4047-b83a-525559eb0729 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.610902 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bedc0023-ac89-4047-b83a-525559eb0729 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.983185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:15.983908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:15.990115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.990634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:15.991445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:15.992081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.019395 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bedc0023-ac89-4047-b83a-525559eb0729 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.421198 Jan 25 03:37:16.020204 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 145/358] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:15 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:16.217881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:16.218580 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:16.228059 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:16.228520 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.229315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:16.229756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.320203 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:16.328949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8cd84bdd-30b3-4140-b664-575696d0122d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.349548 Jan 25 03:37:16.332401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 214/359] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:15 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:16.344138 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:16.348042 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:16.359125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:16.359580 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.360377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:16.360822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.408723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:16.416788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f5fb89bc-5e62-48b3-a8be-6c4046dd3a6b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.204176 Jan 25 03:37:16.419091 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 146/360] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:16 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:16.459622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:16.460231 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:16.466945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:16.469531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.473410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:16.473410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.500723 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:16.508611 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-775587ee-a1c6-49c1-b913-9bdf9a17e1c4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.178126 Jan 25 03:37:16.509181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 215/361] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:16 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:16.609148 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:16.616652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-47e50e51-aecb-44c4-9f06-bce0d9b3d520 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.160658 Jan 25 03:37:16.617241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 147/362] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:16 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:16.968698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-652b7632-9558-42f7-ae53-c133d8e8fe76 req-12ce63f0-0621-4101-b4a5-14a5e1c6ec8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca6ff2e-464f-45a9-a5ba-58ce987262ed", "name": "network-vif-plugged", "status": "completed", "tag": "a4e3c785-fdb7-4f1f-bfdb-ec65f69514eb"}, {"server_uuid": "b7a93cbd-7b1b-4e5a-99f6-e25f560df158", "name": "network-vif-plugged", "status": "completed", "tag": "03218c00-6b39-4ae7-8a61-39eccba27ba4"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:16.970349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:16.970349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:37:16.978070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-652b7632-9558-42f7-ae53-c133d8e8fe76 req-12ce63f0-0621-4101-b4a5-14a5e1c6ec8e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:16.978496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-652b7632-9558-42f7-ae53-c133d8e8fe76 req-12ce63f0-0621-4101-b4a5-14a5e1c6ec8e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:16.991481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-652b7632-9558-42f7-ae53-c133d8e8fe76 req-12ce63f0-0621-4101-b4a5-14a5e1c6ec8e service nova] Creating event network-vif-plugged:a4e3c785-fdb7-4f1f-bfdb-ec65f69514eb for instance 0ca6ff2e-464f-45a9-a5ba-58ce987262ed on hv-cinder-81901 Jan 25 03:37:16.992128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-652b7632-9558-42f7-ae53-c133d8e8fe76 req-12ce63f0-0621-4101-b4a5-14a5e1c6ec8e service nova] Creating event network-vif-plugged:03218c00-6b39-4ae7-8a61-39eccba27ba4 for instance b7a93cbd-7b1b-4e5a-99f6-e25f560df158 on hv-cinder-81901 Jan 25 03:37:16.998162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-652b7632-9558-42f7-ae53-c133d8e8fe76 req-12ce63f0-0621-4101-b4a5-14a5e1c6ec8e service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033569 Jan 25 03:37:16.998754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 216/363] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:17.031021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-acfecf6b-9c3a-4bb4-9b34-d978ae230e98 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:17.032005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-acfecf6b-9c3a-4bb4-9b34-d978ae230e98 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:17.040648 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-acfecf6b-9c3a-4bb4-9b34-d978ae230e98 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.042024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-acfecf6b-9c3a-4bb4-9b34-d978ae230e98 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.044545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-acfecf6b-9c3a-4bb4-9b34-d978ae230e98 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.045364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-acfecf6b-9c3a-4bb4-9b34-d978ae230e98 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.193526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-acfecf6b-9c3a-4bb4-9b34-d978ae230e98 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.166504 Jan 25 03:37:17.194283 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 148/364] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:17 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:17.348622 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:17.349328 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:17.355648 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.356095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.361282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.361282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.434868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:17.435878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:17.442655 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.443132 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.443916 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.444352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.525090 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:17.533938 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b0cf7bc3-1b83-43f5-8a7d-0e2dd0218539 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1322 microversion: 2.1 time: 0.189353 Jan 25 03:37:17.534522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 217/365] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:17 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:17.539908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:17.540744 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:17.547515 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.548375 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.549380 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.550009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.700293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:17.712936 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b1223a87-fa41-460c-96ba-1088c2a7ee5d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.177138 Jan 25 03:37:17.713529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 218/366] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:17 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:17.715305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:17.724075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2b43b08b-401f-4184-ae62-62a39a9bf88b tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.293968 Jan 25 03:37:17.724868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 149/367] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:17 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:17.729262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:17.737428 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:17.745231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.746640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.747914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:17.748577 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:17.916710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:17.924629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bdcf64b2-996a-4846-a847-6fae6a2f2cd0 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.198950 Jan 25 03:37:17.925197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 219/368] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:17 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:18.205647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9f16d2c1-5f05-44fb-aed2-5da72cf74b1c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:18.206573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9f16d2c1-5f05-44fb-aed2-5da72cf74b1c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:18.213645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9f16d2c1-5f05-44fb-aed2-5da72cf74b1c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.214105 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9f16d2c1-5f05-44fb-aed2-5da72cf74b1c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.215483 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9f16d2c1-5f05-44fb-aed2-5da72cf74b1c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.215916 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9f16d2c1-5f05-44fb-aed2-5da72cf74b1c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.551942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:18.552562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:18.559971 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.560429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.561236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.561656 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.694631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:18.702463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f53025c6-8ec2-4012-8bda-299b6b7c0a7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1513 microversion: 2.1 time: 0.155054 Jan 25 03:37:18.703038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 220/369] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:18 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:18.718975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb508e8-dbd2-4f61-901c-7db7fdcf6967"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:18.720101 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:18.725976 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.726434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.727257 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.737692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.805275 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] HTTP exception thrown: Invalid volume: volume dcb508e8-dbd2-4f61-901c-7db7fdcf6967 is already attached to instances: b83cc2c8-a438-49f9-b79c-e74359899f65 Jan 25 03:37:18.805893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Returning 400 to user: Invalid volume: volume dcb508e8-dbd2-4f61-901c-7db7fdcf6967 is already attached to instances: b83cc2c8-a438-49f9-b79c-e74359899f65 {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:18.806725 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-941311d4-2207-4150-9454-9c78abb55ac7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091512 Jan 25 03:37:18.807314 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 221/370] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:37:18 2022] POST /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 25 03:37:18.814657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:18.814657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:18.819393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.819861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.821054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.821862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.944400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9f16d2c1-5f05-44fb-aed2-5da72cf74b1c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.742355 Jan 25 03:37:18.945808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 150/371] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:18 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:18.953330 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:18.954037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:18.961033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.961488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.962273 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.962746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.963816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:18.971243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8c1cfa4d-9aca-413c-a30b-af16848cc2aa tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.162903 Jan 25 03:37:18.971798 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 222/372] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:18 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:18.976243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:18.976984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:18.983014 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.983498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:18.984267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:18.984701 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:19.138063 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'services' on Instance uuid b83cc2c8-a438-49f9-b79c-e74359899f65 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:19.168895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:19.179945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d56a31e8-5fb3-4a7a-a4ff-faba41b64bac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.232841 Jan 25 03:37:19.180927 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 151/373] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:18 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:19.188242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:19.188888 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:19.195435 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:19.196149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:19.197137 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:19.198030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:19.363811 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:19.371672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-402cede2-fb6c-4005-9388-c0c5b9a7372f tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.188490 Jan 25 03:37:19.372247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 152/374] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:19 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:19.446836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f9f10145-6a31-468d-96da-4160f3169b80 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments/dcb508e8-dbd2-4f61-901c-7db7fdcf6967" status: 202 len: 0 microversion: 2.1 time: 0.473662 Jan 25 03:37:19.447895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 223/375] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:37:18 2022] DELETE /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments/dcb508e8-dbd2-4f61-901c-7db7fdcf6967 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:19.456192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7198d1cb-05c6-4265-b57d-eca62314e7e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:19.460975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7198d1cb-05c6-4265-b57d-eca62314e7e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:19.463186 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7198d1cb-05c6-4265-b57d-eca62314e7e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:19.463804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7198d1cb-05c6-4265-b57d-eca62314e7e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:19.464889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7198d1cb-05c6-4265-b57d-eca62314e7e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:19.465513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7198d1cb-05c6-4265-b57d-eca62314e7e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:19.500392 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7198d1cb-05c6-4265-b57d-eca62314e7e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047951 Jan 25 03:37:19.501244 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 153/376] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:37:19 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:19.957181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8d49c537-2d4f-4362-b2e6-9266a3a5e93d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:19.958216 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8d49c537-2d4f-4362-b2e6-9266a3a5e93d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:19.964971 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d49c537-2d4f-4362-b2e6-9266a3a5e93d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:19.965418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d49c537-2d4f-4362-b2e6-9266a3a5e93d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:19.966186 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d49c537-2d4f-4362-b2e6-9266a3a5e93d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:19.966617 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d49c537-2d4f-4362-b2e6-9266a3a5e93d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:19.988785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:19.989595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:19.995891 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:19.996343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.003127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:20.003127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.098062 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8d49c537-2d4f-4362-b2e6-9266a3a5e93d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.145156 Jan 25 03:37:20.101926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 224/377] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:19 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:20.142040 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:20.149424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-083d99e3-6876-4674-b6b2-0ca30cd4d1cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.164218 Jan 25 03:37:20.150079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 154/378] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:19 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:20.200966 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:20.201661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:20.208686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:20.209132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.209903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:20.210336 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.348325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:20.418443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-85e3010d-71db-4c32-a9aa-d86ecb9322ae tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1318 microversion: 2.1 time: 0.159307 Jan 25 03:37:20.418443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 225/379] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:20 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:20.418857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:20.418857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:20.418857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:20.418857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.419517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:20.419517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.512570 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1742692b-72cb-436c-a95a-f5874dac756c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:20.513641 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1742692b-72cb-436c-a95a-f5874dac756c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:20.530922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1742692b-72cb-436c-a95a-f5874dac756c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:20.531421 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1742692b-72cb-436c-a95a-f5874dac756c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.532223 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1742692b-72cb-436c-a95a-f5874dac756c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:20.532698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1742692b-72cb-436c-a95a-f5874dac756c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:20.536345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:20.545062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b2c9cd5d-ce80-4d06-9ce4-47e40ae9d273 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1317 microversion: 2.1 time: 0.160571 Jan 25 03:37:20.545873 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 155/380] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:20 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:20.585131 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1742692b-72cb-436c-a95a-f5874dac756c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076871 Jan 25 03:37:20.585683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 226/381] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:37:20 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:37:21.110362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b04b19c0-4ff2-4862-a9b9-b4fcb967cca3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:21.111290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b04b19c0-4ff2-4862-a9b9-b4fcb967cca3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:21.118255 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b04b19c0-4ff2-4862-a9b9-b4fcb967cca3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.118410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b04b19c0-4ff2-4862-a9b9-b4fcb967cca3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.119471 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b04b19c0-4ff2-4862-a9b9-b4fcb967cca3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.119759 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b04b19c0-4ff2-4862-a9b9-b4fcb967cca3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.166361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:21.166998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:21.173424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.173878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.174687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.175164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.256928 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b04b19c0-4ff2-4862-a9b9-b4fcb967cca3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.149174 Jan 25 03:37:21.258084 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 156/382] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:21 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:21.316373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:21.324045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b1c84020-229c-4e79-b29d-021c18d70f19 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.161442 Jan 25 03:37:21.324927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 227/383] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:21 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:21.374711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:21.375539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:21.383240 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.383748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.384648 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.385171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.528709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:21.536608 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-07a88774-6132-4c69-acb6-b01497c29742 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1503 microversion: 2.1 time: 0.166562 Jan 25 03:37:21.537188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 157/384] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:21 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:21.564346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:21.565033 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:21.571029 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.571518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.572574 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.573047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.596466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d9fe8db6-b88c-4339-b3a1-3e07e2810ade tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:21.597530 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d9fe8db6-b88c-4339-b3a1-3e07e2810ade tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:21.604446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9fe8db6-b88c-4339-b3a1-3e07e2810ade tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.604446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9fe8db6-b88c-4339-b3a1-3e07e2810ade tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.605852 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9fe8db6-b88c-4339-b3a1-3e07e2810ade tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.606345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9fe8db6-b88c-4339-b3a1-3e07e2810ade tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.637439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d9fe8db6-b88c-4339-b3a1-3e07e2810ade tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044707 Jan 25 03:37:21.642587 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 158/385] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:37:21 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:37:21.715173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:21.722719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-69ad4dc2-15d4-4673-9d66-1ad2451e0aa8 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1466 microversion: 2.1 time: 0.162121 Jan 25 03:37:21.728746 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 228/386] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:21 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:21.914913 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:21.915648 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:21.922598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.923071 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.923961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:21.924423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:21.952646 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:37:21.991816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-691280573", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "835e181b-635d-41dd-9269-42b6c17d0334"}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:22.043584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] validate_networks() for [('835e181b-635d-41dd-9269-42b6c17d0334', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:37:22.289528 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9e6d9fcf-843b-4310-9f02-954e65ccaadc tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 204 len: 0 microversion: 2.1 time: 0.403875 Jan 25 03:37:22.297876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 159/387] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:37:21 2022] DELETE /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:37:22.297876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-db58ff63-b36b-4002-ab50-00f606062ac9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:22.298832 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-db58ff63-b36b-4002-ab50-00f606062ac9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:22.308027 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db58ff63-b36b-4002-ab50-00f606062ac9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.308639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db58ff63-b36b-4002-ab50-00f606062ac9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.312458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db58ff63-b36b-4002-ab50-00f606062ac9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.312912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db58ff63-b36b-4002-ab50-00f606062ac9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.477886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:37:22.478371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:37:22.478758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:37:22.479190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:37:22.479884 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:37:22.489214 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.489664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.490464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.490898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.507241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:37:22.511816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for user 66a4cd3a6bc441d8b1d4bfdd15a6402d and project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:37:22.522957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:37:22.525371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:37:22.650990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d1c7b892-7170-43a7-bea8-7a07b32509c0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.662869 Jan 25 03:37:22.652632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 229/388] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:37:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 25 03:37:22.657194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:22.657875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:22.664210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.666271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.666271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.666271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.809461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:22.817164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-42ca58f9-b321-498d-81ed-c4b2e232834a tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1472 microversion: 2.1 time: 0.163540 Jan 25 03:37:22.817741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 230/389] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:22 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:22.821959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:22.822830 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:22.829934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.836477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.836477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:22.836477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:22.961469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:22.969536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5c4c7f14-13ed-4052-a2c1-580f3c2211d9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.150808 Jan 25 03:37:22.970161 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 231/390] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:22 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:22.974429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7556c647-1158-433e-9c47-ad2e165d3eb9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:22.974996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7556c647-1158-433e-9c47-ad2e165d3eb9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:23.050033 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7556c647-1158-433e-9c47-ad2e165d3eb9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:23.056571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7556c647-1158-433e-9c47-ad2e165d3eb9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1221 microversion: 2.1 time: 0.085491 Jan 25 03:37:23.057136 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 232/391] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:22 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:23.835779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:23.836416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:23.843366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:23.843823 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:23.844596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:23.845032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:23.973934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:23.981258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0f6e26e2-3664-4b1f-9080-5d48f6671844 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1472 microversion: 2.1 time: 0.149073 Jan 25 03:37:23.983621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 233/392] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:23 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1472 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:23.990880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:23.991518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:23.997282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:23.997730 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:24.000462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:24.000909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:24.130942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:24.138800 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e6f2d564-7a7b-4ca4-9ce2-db281b87a6be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.151413 Jan 25 03:37:24.139416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 234/393] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:23 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:24.143702 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:24.144373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:24.150046 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:24.150504 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:24.151318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:24.152384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:24.213865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:24.221321 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-81b8836e-67a3-45f2-8fa5-a848afd17de8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1225 microversion: 2.1 time: 0.080931 Jan 25 03:37:24.221954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 235/394] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:24 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:24.997961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:24.998636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:25.004933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:25.005388 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:25.006161 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:25.006600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:25.131910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:25.139292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-eb451ff2-184e-4ccc-8424-95864f90d670 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1472 microversion: 2.1 time: 0.145311 Jan 25 03:37:25.139868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 236/395] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:24 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1472 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:25.155521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:25.156123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:25.161626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:25.162126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:25.162903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:25.163377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:25.289245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:25.297096 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-64b84cb5-10c9-447e-b393-e02c22dd26dc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.145432 Jan 25 03:37:25.297671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 237/396] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:25 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:25.303158 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:25.305773 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:25.311567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:25.312029 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:25.312805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:25.313279 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:25.374072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:25.381385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-15f5dd75-264e-4dcf-b5f4-b14c48763493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1225 microversion: 2.1 time: 0.081479 Jan 25 03:37:25.381949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 238/397] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:25 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:25.794510 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-db58ff63-b36b-4002-ab50-00f606062ac9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 3.502113 Jan 25 03:37:25.795955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 160/398] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:22 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 3504 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:26.155651 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:26.156262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:26.162582 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.163032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.163846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.164281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.298217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:26.305524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-99abde8c-3784-4144-a64d-93d76281e6e5 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1472 microversion: 2.1 time: 0.153738 Jan 25 03:37:26.306147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 239/399] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:26 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1472 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:26.314793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:26.315511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:26.322857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.329309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.329309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.329309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.398502 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:26.399149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:26.406299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.406768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.407636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.408070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.467035 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:26.471660 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:26.474933 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2d8bce3f-ce8c-4c3b-8445-019515b7378d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.164093 Jan 25 03:37:26.475553 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 161/400] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:26 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:26.479125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3c886534-7135-42c5-9a1a-eb561e72b641 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1273 microversion: 2.1 time: 0.084531 Jan 25 03:37:26.488267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 240/401] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:26 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:26.787029 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:26.787541 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:26.794245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.794675 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.795472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.795899 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.806411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e010d795-f81a-41b7-ba1d-5f9808ab9f9b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:26.807495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e010d795-f81a-41b7-ba1d-5f9808ab9f9b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:26.814851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e010d795-f81a-41b7-ba1d-5f9808ab9f9b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.818265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e010d795-f81a-41b7-ba1d-5f9808ab9f9b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.818265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e010d795-f81a-41b7-ba1d-5f9808ab9f9b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:26.818265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e010d795-f81a-41b7-ba1d-5f9808ab9f9b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:26.822025 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:37:26.955600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e010d795-f81a-41b7-ba1d-5f9808ab9f9b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.153402 Jan 25 03:37:26.959460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 241/402] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:26 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:27.047893 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5737a8b1-40c7-4b44-9bfb-56fe85b9203c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "DELETE /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 204 len: 0 microversion: 2.1 time: 0.262728 Jan 25 03:37:27.048612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 162/403] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:37:26 2022] DELETE /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:37:27.056940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:27.057648 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:27.064995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.065452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.066231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.071547 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.206373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:27.213795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-08cb051a-f898-4a2a-97c1-55490fa2547f tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1509 microversion: 2.1 time: 0.161008 Jan 25 03:37:27.214952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 242/404] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:27 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:27.323745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:27.324828 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:27.333060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.334768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.335852 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.336592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.494484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:27.495261 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:27.500105 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:27.502836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.503227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.504019 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.504461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.520108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5d52e2a2-9d7d-44cc-bfb1-90d4d73fc0b4 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1472 microversion: 2.1 time: 0.191046 Jan 25 03:37:27.520108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 163/405] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:27 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:27.525169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:27.525866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:27.532797 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.533338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.534232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.534727 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.606010 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:27.614411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-133d2ffc-adde-4b86-862b-fce6516c1e7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1279 microversion: 2.1 time: 0.102387 Jan 25 03:37:27.616304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 164/406] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:27 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:27.717142 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:27.727843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b8df68cd-cf2d-4ba9-8fe2-f2d43bb71bf1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.236698 Jan 25 03:37:27.727843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 243/407] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:27 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:27.967447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-82b17472-7a7c-4744-a187-5d62fa750f96 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:27.968499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-82b17472-7a7c-4744-a187-5d62fa750f96 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:27.975139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82b17472-7a7c-4744-a187-5d62fa750f96 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.975599 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82b17472-7a7c-4744-a187-5d62fa750f96 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:27.976379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82b17472-7a7c-4744-a187-5d62fa750f96 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:27.976810 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82b17472-7a7c-4744-a187-5d62fa750f96 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.102117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-82b17472-7a7c-4744-a187-5d62fa750f96 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.138497 Jan 25 03:37:28.108642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 165/408] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:27 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:28.232182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:28.235816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:28.246896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.248513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.251559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.254843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.408796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:28.416589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-48c583d7-d240-4832-9722-ed55e95e03a4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1509 microversion: 2.1 time: 0.188802 Jan 25 03:37:28.417192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 244/409] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:28 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:28.528179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:28.528877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:28.535659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.536303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.537065 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.537659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.631570 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:28.632192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:28.638845 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.639497 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.640473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.640920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.830078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:28.838456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-456ba5d2-48a7-4b3b-a9cc-96bc7066c23f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.210687 Jan 25 03:37:28.842180 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 245/410] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:28 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:28.844823 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:28.845536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:28.851707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.852456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.853460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:28.854112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:28.912170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:28.925020 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7d212c74-3734-4f9e-9551-138fecadce4c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1472 microversion: 2.1 time: 0.401469 Jan 25 03:37:28.927789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 166/411] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:28 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:28.998643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:29.006021 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2d558acd-96ce-426f-b3dd-e1d0242d64ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.165308 Jan 25 03:37:29.015847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 246/412] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:28 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:29.121627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5c166529-bd75-4f95-a80d-41058b360218 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:29.123944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5c166529-bd75-4f95-a80d-41058b360218 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:29.136218 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c166529-bd75-4f95-a80d-41058b360218 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.136755 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c166529-bd75-4f95-a80d-41058b360218 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.138279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c166529-bd75-4f95-a80d-41058b360218 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.138788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c166529-bd75-4f95-a80d-41058b360218 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.260028 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5c166529-bd75-4f95-a80d-41058b360218 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.145574 Jan 25 03:37:29.265029 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 167/413] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:29 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:29.434829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:29.435516 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:29.441663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.442289 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.443728 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.444472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.585471 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-ac3b8c53-8487-4629-9090-1ef3914d6c0c req-02664700-9683-4003-b143-da895f698745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7a93cbd-7b1b-4e5a-99f6-e25f560df158", "name": "network-vif-deleted", "tag": "03218c00-6b39-4ae7-8a61-39eccba27ba4"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:29.589659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:29.589659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:37:29.600229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ac3b8c53-8487-4629-9090-1ef3914d6c0c req-02664700-9683-4003-b143-da895f698745 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.601052 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ac3b8c53-8487-4629-9090-1ef3914d6c0c req-02664700-9683-4003-b143-da895f698745 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.619456 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-ac3b8c53-8487-4629-9090-1ef3914d6c0c req-02664700-9683-4003-b143-da895f698745 service nova] Creating event network-vif-deleted:03218c00-6b39-4ae7-8a61-39eccba27ba4 for instance b7a93cbd-7b1b-4e5a-99f6-e25f560df158 on hv-cinder-81901 Jan 25 03:37:29.627497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-ac3b8c53-8487-4629-9090-1ef3914d6c0c req-02664700-9683-4003-b143-da895f698745 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046480 Jan 25 03:37:29.628536 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 168/414] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:29.641673 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:29.649458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-eeea4dc0-c4ce-4caf-9f02-279088a4be8c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1509 microversion: 2.1 time: 0.218849 Jan 25 03:37:29.671357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 247/415] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:29 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:29.856725 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:29.857417 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:29.863260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.863701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.864468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.864895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.950711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:29.951570 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:29.960405 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.961304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:29.962176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:29.962627 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:30.006517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:30.015113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1d5183a1-0329-418f-96c8-ac2ec38e8437 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.162923 Jan 25 03:37:30.015866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 169/416] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:29 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:30.029508 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:30.033352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:30.033829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:30.037506 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:30.037977 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:30.038855 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:30.039169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-367879da-a018-4f72-b27c-5f25b9b57211 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1430 microversion: 2.1 time: 0.093752 Jan 25 03:37:30.039454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:30.039754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 248/417] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:29 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1430 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:30.185867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:30.193331 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f762fdee-278c-4210-b5cc-797aa81c9036 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.173907 Jan 25 03:37:30.193901 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 170/418] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:30 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:30.275709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7332c7c4-e8a3-45bf-aa0a-bd943b321a5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:30.281513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7332c7c4-e8a3-45bf-aa0a-bd943b321a5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:30.283542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7332c7c4-e8a3-45bf-aa0a-bd943b321a5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:30.283996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7332c7c4-e8a3-45bf-aa0a-bd943b321a5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:30.284784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7332c7c4-e8a3-45bf-aa0a-bd943b321a5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:30.285221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7332c7c4-e8a3-45bf-aa0a-bd943b321a5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:30.535208 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7332c7c4-e8a3-45bf-aa0a-bd943b321a5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.263522 Jan 25 03:37:30.536089 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 249/419] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:30 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:30.670153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:30.670763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:30.677020 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:30.677563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:30.678340 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:30.678769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:30.975594 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:30.983631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a455ec3d-3d3a-43bd-a85f-8928974ed2ca tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1509 microversion: 2.1 time: 0.317750 Jan 25 03:37:30.984270 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 171/420] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:30 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:31.033815 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:31.034676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:31.049251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.049251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.049251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.049251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.058960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:31.060593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:31.067969 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.068857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.070384 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.071213 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.114092 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.114717 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.115746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lazy-loading 'fault' on Instance uuid b7a93cbd-7b1b-4e5a-99f6-e25f560df158 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:31.173535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a1023547698429c9c5dac76faf5cc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42d3702511c4fb08d050300e23d66a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:31.191239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-24066466-a7f1-473b-919e-dab72916c334 tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 200 len: 1307 microversion: 2.1 time: 0.129196 Jan 25 03:37:31.193720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 172/421] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:31 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:31.204997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:31.211312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8cbc8174-75ac-46e1-8a0f-3e83641a8d7a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.182171 Jan 25 03:37:31.213545 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 250/422] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:31 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:31.216316 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:31.217051 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:31.230456 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.230904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.233464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.233962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.423377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:31.430713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f0c2ab60-9358-472e-89e6-69eb9430b364 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.222449 Jan 25 03:37:31.431303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 173/423] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:31 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:31.546099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ae95841e-f511-4661-8cc0-b4ab283d4357 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:31.547183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ae95841e-f511-4661-8cc0-b4ab283d4357 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:31.553832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae95841e-f511-4661-8cc0-b4ab283d4357 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.554382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae95841e-f511-4661-8cc0-b4ab283d4357 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.555274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae95841e-f511-4661-8cc0-b4ab283d4357 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.555717 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae95841e-f511-4661-8cc0-b4ab283d4357 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.642233 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-01b00b26-af53-4218-93ec-fd4ac3bf0d2f req-32e51252-bf94-460b-b8d4-aea4c88114d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c1b7caf-2414-4373-a49c-b8374358d3f3", "tag": "06409dab-f866-4e30-91b3-02bed40f3fbc"}, {"server_uuid": "0ca6ff2e-464f-45a9-a5ba-58ce987262ed", "name": "network-vif-deleted", "tag": "a4e3c785-fdb7-4f1f-bfdb-ec65f69514eb"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:31.643982 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:31.643982 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:37:31.652340 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-01b00b26-af53-4218-93ec-fd4ac3bf0d2f req-32e51252-bf94-460b-b8d4-aea4c88114d2 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:31.652775 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-01b00b26-af53-4218-93ec-fd4ac3bf0d2f req-32e51252-bf94-460b-b8d4-aea4c88114d2 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:31.666248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-01b00b26-af53-4218-93ec-fd4ac3bf0d2f req-32e51252-bf94-460b-b8d4-aea4c88114d2 service nova] Creating event network-changed:06409dab-f866-4e30-91b3-02bed40f3fbc for instance 9c1b7caf-2414-4373-a49c-b8374358d3f3 on hv-cinder-81901 Jan 25 03:37:31.666748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-01b00b26-af53-4218-93ec-fd4ac3bf0d2f req-32e51252-bf94-460b-b8d4-aea4c88114d2 service nova] Creating event network-vif-deleted:a4e3c785-fdb7-4f1f-bfdb-ec65f69514eb for instance 0ca6ff2e-464f-45a9-a5ba-58ce987262ed on hv-cinder-81901 Jan 25 03:37:31.673053 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-01b00b26-af53-4218-93ec-fd4ac3bf0d2f req-32e51252-bf94-460b-b8d4-aea4c88114d2 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034348 Jan 25 03:37:31.673650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 174/424] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:37:31.795876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ae95841e-f511-4661-8cc0-b4ab283d4357 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.253626 Jan 25 03:37:31.796842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 251/425] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:31 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:32.005395 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:32.006361 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.022455 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.022975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.023863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.024366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.057808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.058373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.059126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lazy-loading 'fault' on Instance uuid 0ca6ff2e-464f-45a9-a5ba-58ce987262ed {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:32.109169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:32.116375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-995ee745-50ab-456f-b36d-aefa63b2e714 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 200 len: 1308 microversion: 2.1 time: 0.115324 Jan 25 03:37:32.117053 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 175/426] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:31 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:32.213675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:32.214225 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] [instance: b7a93cbd-7b1b-4e5a-99f6-e25f560df158] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.221859 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.222509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.223403 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.223847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.231038 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:32.233269 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.239742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] HTTP exception thrown: Instance b7a93cbd-7b1b-4e5a-99f6-e25f560df158 could not be found. Jan 25 03:37:32.240353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] Returning 404 to user: Instance b7a93cbd-7b1b-4e5a-99f6-e25f560df158 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:32.240548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.242484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.242595 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-323544b2-6d1e-4905-b649-c1009c8e937c tempest-VolumesNegativeTest-1967070326 tempest-VolumesNegativeTest-1967070326-project] 10.222.0.115 "GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158" status: 404 len: 111 microversion: 2.1 time: 0.032467 Jan 25 03:37:32.242677 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.242752 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 252/427] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:32 2022] GET /compute/v2.1/servers/b7a93cbd-7b1b-4e5a-99f6-e25f560df158 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:37:32.242824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.450010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:32.451272 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.463411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.464143 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.465177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.467741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.508558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:32.517923 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e6ce7d4a-fc9b-444c-9783-17a68a15396f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.291565 Jan 25 03:37:32.527561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 176/428] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:32 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:32.615177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:32.629051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3fbf41b4-719e-4d00-9e59-9ef828e1a6cc tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1507 microversion: 2.1 time: 0.184172 Jan 25 03:37:32.630916 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 253/429] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:32 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:32.647789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab2bedc1-6512-420b-8486-ea658d0edc07"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:32.649099 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.658534 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.658992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.659848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.660284 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.693538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] HTTP exception thrown: Cannot 'attach_volume' instance 17d82b81-05dd-4075-8d84-577551c2a689 while it is in vm_state rescued Jan 25 03:37:32.693538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Returning 409 to user: Cannot 'attach_volume' instance 17d82b81-05dd-4075-8d84-577551c2a689 while it is in vm_state rescued {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:32.693782 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9fd881fd-6ebe-4bcc-9c76-6d8fb95c1b61 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050116 Jan 25 03:37:32.694555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 177/430] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:37:32 2022] POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 25 03:37:32.706309 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-db41f7f0-3292-4245-b3e1-5923bef43f33 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:32.706813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-db41f7f0-3292-4245-b3e1-5923bef43f33 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.716285 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db41f7f0-3292-4245-b3e1-5923bef43f33 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.717053 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db41f7f0-3292-4245-b3e1-5923bef43f33 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.718596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db41f7f0-3292-4245-b3e1-5923bef43f33 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.719704 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db41f7f0-3292-4245-b3e1-5923bef43f33 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.807699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-67f1a248-5f08-4c9b-84cc-65b2b06e1f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:32.814739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-67f1a248-5f08-4c9b-84cc-65b2b06e1f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.821386 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67f1a248-5f08-4c9b-84cc-65b2b06e1f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.822326 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67f1a248-5f08-4c9b-84cc-65b2b06e1f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.823380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67f1a248-5f08-4c9b-84cc-65b2b06e1f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.824147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67f1a248-5f08-4c9b-84cc-65b2b06e1f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.949639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-67f1a248-5f08-4c9b-84cc-65b2b06e1f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.145736 Jan 25 03:37:32.954245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 178/431] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:32 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:32.964930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-db41f7f0-3292-4245-b3e1-5923bef43f33 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action" status: 202 len: 0 microversion: 2.1 time: 0.262292 Jan 25 03:37:32.965658 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 254/432] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:37:32 2022] POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:32.975673 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:32.976381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:32.984207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.984662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:32.985945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:32.985945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:33.136314 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:33.136825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:33.137211 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 0ca6ff2e-464f-45a9-a5ba-58ce987262ed] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:33.144505 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:33.145189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:33.146436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:33.147192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:33.157121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2b783181-0cac-4d84-9820-5db93de40aca tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1515 microversion: 2.1 time: 0.185182 Jan 25 03:37:33.158133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 179/433] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:32 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:33.174524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] HTTP exception thrown: Instance 0ca6ff2e-464f-45a9-a5ba-58ce987262ed could not be found. Jan 25 03:37:33.175183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Returning 404 to user: Instance 0ca6ff2e-464f-45a9-a5ba-58ce987262ed could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:33.176614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c9e3a8fc-75c5-4a14-91be-5a8f1e4fcfe0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed" status: 404 len: 111 microversion: 2.1 time: 0.045068 Jan 25 03:37:33.178706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 255/434] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:33 2022] GET /compute/v2.1/servers/0ca6ff2e-464f-45a9-a5ba-58ce987262ed => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:37:33.293406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-651140453", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "5a6ed931-4b24-4be4-b671-86c474190d7e"}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:33.398673 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] validate_networks() for [('5a6ed931-4b24-4be4-b671-86c474190d7e', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:37:33.535492 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:33.536098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:33.549084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:33.553144 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:33.554208 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:33.555742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:33.873702 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:33.897003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4c397321-17e3-4a9e-b3c2-4c9e659bb3a9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.363380 Jan 25 03:37:33.897921 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 256/435] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:33 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:33.977729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7e9f08e9-a919-44a8-9720-a1181b8e71b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:33.979566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7e9f08e9-a919-44a8-9720-a1181b8e71b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:33.995292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7e9f08e9-a919-44a8-9720-a1181b8e71b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:33.996474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7e9f08e9-a919-44a8-9720-a1181b8e71b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:33.999076 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7e9f08e9-a919-44a8-9720-a1181b8e71b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:33.999426 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7e9f08e9-a919-44a8-9720-a1181b8e71b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:34.114358 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:37:34.114985 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:37:34.115634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:37:34.116228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:37:34.116645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:37:34.128097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7e9f08e9-a919-44a8-9720-a1181b8e71b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.165736 Jan 25 03:37:34.128498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:34.129128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:34.129674 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 257/436] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:33 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:34.130379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:34.131169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:34.151743 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Getting quotas for project 9572dffe747a4371ace5d887368ca64b. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:37:34.155344 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Getting quotas for user 3b9244d123024af08f3e75c09a5b586b and project 9572dffe747a4371ace5d887368ca64b. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:37:34.174434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:34.175153 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:34.176841 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:37:34.179202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:37:34.182453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:34.182895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:34.183869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:34.185020 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:34.295389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3cfac9e1-3662-4c1f-8c9b-8b5b471945ac tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.006586 Jan 25 03:37:34.297079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 180/437] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:37:33 2022] POST /compute/v2.1/servers => generated 382 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:37:34.322119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-eb98f403-5100-438a-ac7a-dee468e2690d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:34.322119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-eb98f403-5100-438a-ac7a-dee468e2690d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:34.402534 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eb98f403-5100-438a-ac7a-dee468e2690d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:34.410978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-eb98f403-5100-438a-ac7a-dee468e2690d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1217 microversion: 2.1 time: 0.098478 Jan 25 03:37:34.411987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 181/438] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:34 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:34.421859 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:34.429128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0d42e744-f455-4034-bf64-cadb4fc03314 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1515 microversion: 2.1 time: 0.255493 Jan 25 03:37:34.429128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 258/439] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:34 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:34.914682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:34.915336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:34.923621 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:34.924071 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:34.928748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:34.928748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:35.061699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:35.073419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2157df15-b8f3-476f-921a-a419a6524b7b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.161881 Jan 25 03:37:35.074592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 182/440] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:34 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:35.140843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6612a345-1069-43f7-ad48-56c5086bd47d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:35.142821 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6612a345-1069-43f7-ad48-56c5086bd47d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:35.150116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6612a345-1069-43f7-ad48-56c5086bd47d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:35.150827 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6612a345-1069-43f7-ad48-56c5086bd47d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:35.152649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6612a345-1069-43f7-ad48-56c5086bd47d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:35.152649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6612a345-1069-43f7-ad48-56c5086bd47d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:35.277852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6612a345-1069-43f7-ad48-56c5086bd47d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28184 microversion: 2.20 time: 0.141094 Jan 25 03:37:35.278514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 259/441] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:35 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28184 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:35.429735 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:35.430997 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:35.446123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:35.447738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:35.454770 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:35.454770 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:35.454770 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:35.454770 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:35.460245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:35.461065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:35.462098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:35.462625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:35.531696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:35.540502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b78c1ac3-aa1f-4c91-b0b8-4d33f8201210 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1221 microversion: 2.1 time: 0.114324 Jan 25 03:37:35.541236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 183/442] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:35 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:35.647370 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:35.655019 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0a114bc7-2d97-44b2-8396-6ba38511e2f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1515 microversion: 2.1 time: 0.213176 Jan 25 03:37:35.667134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 260/443] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:35 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:36.092970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:36.093728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:36.099816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.102329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.102329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.102329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.249375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:36.255427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-87d90978-adc8-4d6e-a75d-25b9b1f2dfbf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.167221 Jan 25 03:37:36.256302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 184/444] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:36 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:36.289630 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-61d2cdea-b747-4877-bf96-66a625f63f61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:36.290610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-61d2cdea-b747-4877-bf96-66a625f63f61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:36.297815 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61d2cdea-b747-4877-bf96-66a625f63f61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.298276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61d2cdea-b747-4877-bf96-66a625f63f61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.299107 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61d2cdea-b747-4877-bf96-66a625f63f61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.299549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-61d2cdea-b747-4877-bf96-66a625f63f61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.527398 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-61d2cdea-b747-4877-bf96-66a625f63f61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28475 microversion: 2.20 time: 0.240913 Jan 25 03:37:36.530335 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 261/445] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:36 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28475 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:36.558247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:36.559253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:36.566925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.567472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.568259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.568724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.637041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:36.644827 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6fba492d-ab09-4f64-9db2-8aa589b086bc tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1269 microversion: 2.1 time: 0.090994 Jan 25 03:37:36.645401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 185/446] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:36 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:36.674844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:36.675893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:36.682796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.683496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.684522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:36.685183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:36.844175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:36.851897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f90035ff-18b2-4862-88cb-df69242a9102 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1515 microversion: 2.1 time: 0.181087 Jan 25 03:37:36.852469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 262/447] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:36 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:37.273369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:37.274329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:37.285781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.286413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:37.288148 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.288895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:37.494486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:37.507806 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b98ccfed-04dd-4ac1-9763-0e0ecb6255a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.236740 Jan 25 03:37:37.508927 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 186/448] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:37 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:37.541231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2c119356-9e4c-48a6-a69b-dfc4bd30c890 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:37.542580 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2c119356-9e4c-48a6-a69b-dfc4bd30c890 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:37.561545 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2c119356-9e4c-48a6-a69b-dfc4bd30c890 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.561994 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2c119356-9e4c-48a6-a69b-dfc4bd30c890 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:37.562809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2c119356-9e4c-48a6-a69b-dfc4bd30c890 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.571446 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2c119356-9e4c-48a6-a69b-dfc4bd30c890 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:37.667014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:37.667652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:37.677453 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.678132 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:37.679501 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.680116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:37.696047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2c119356-9e4c-48a6-a69b-dfc4bd30c890 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28475 microversion: 2.20 time: 0.158376 Jan 25 03:37:37.696960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 263/449] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:37 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28475 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:37.774863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:37.792097 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8f67595d-9a3f-4249-8364-0d38d3583ef4 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1275 microversion: 2.1 time: 0.130300 Jan 25 03:37:37.803597 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 187/450] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:37 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:37.872853 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:37.875985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:37.898888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.898888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:37.898888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:37.898888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:38.050671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:38.060584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6656c84a-b438-4814-afd0-3782aa8a1be2 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1521 microversion: 2.1 time: 0.192801 Jan 25 03:37:38.065494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 264/451] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:37 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:38.528542 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:38.529491 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:38.539243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:38.539691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:38.540489 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:38.540929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:38.712836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ca306593-062d-4a34-99fa-e9c6108101b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:38.719559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ca306593-062d-4a34-99fa-e9c6108101b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:38.721757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca306593-062d-4a34-99fa-e9c6108101b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:38.722432 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca306593-062d-4a34-99fa-e9c6108101b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:38.723481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca306593-062d-4a34-99fa-e9c6108101b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:38.724140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca306593-062d-4a34-99fa-e9c6108101b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:38.836783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ca306593-062d-4a34-99fa-e9c6108101b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.126658 Jan 25 03:37:38.837445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 265/452] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:38 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:38.847567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:38.852986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:38.857863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:38.877292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:38.877292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:38.877292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:38.877292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:38.881225 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8722645f-4116-44f8-8f2e-f09bb7f450ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.356879 Jan 25 03:37:38.882339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 188/453] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:38 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:39.085914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:39.089473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b0491b2d-822d-48e1-8c1b-e9adae60ebbf tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.248208 Jan 25 03:37:39.090066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 266/454] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:38 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:39.181753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-38e44403-73c6-4520-ac6a-75f9f89c5275 req-440c4e2d-b09e-4188-b2a4-aa77dbdb77bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1b7caf-2414-4373-a49c-b8374358d3f3", "name": "network-vif-plugged", "status": "completed", "tag": "06409dab-f866-4e30-91b3-02bed40f3fbc"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:39.187121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:39.187121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:37:39.191357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-38e44403-73c6-4520-ac6a-75f9f89c5275 req-440c4e2d-b09e-4188-b2a4-aa77dbdb77bc service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:39.192055 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-38e44403-73c6-4520-ac6a-75f9f89c5275 req-440c4e2d-b09e-4188-b2a4-aa77dbdb77bc service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:39.205077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-38e44403-73c6-4520-ac6a-75f9f89c5275 req-440c4e2d-b09e-4188-b2a4-aa77dbdb77bc service nova] Creating event network-vif-plugged:06409dab-f866-4e30-91b3-02bed40f3fbc for instance 9c1b7caf-2414-4373-a49c-b8374358d3f3 on hv-cinder-81901 Jan 25 03:37:39.210257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-38e44403-73c6-4520-ac6a-75f9f89c5275 req-440c4e2d-b09e-4188-b2a4-aa77dbdb77bc service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032881 Jan 25 03:37:39.211203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 189/455] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:39.383216 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-c0d0b27c-1c07-4bf4-9056-3f79bed8a6f1 req-387c4188-5510-471f-a720-0c2b98cc1745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54723a9d-3cbe-4901-84fc-c0635a5f0f20", "tag": "fd0ac6a9-c23b-4d52-9aad-a28d1d316935"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:39.385339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:39.385339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:37:39.394608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-c0d0b27c-1c07-4bf4-9056-3f79bed8a6f1 req-387c4188-5510-471f-a720-0c2b98cc1745 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:39.395075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-c0d0b27c-1c07-4bf4-9056-3f79bed8a6f1 req-387c4188-5510-471f-a720-0c2b98cc1745 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:39.423479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-c0d0b27c-1c07-4bf4-9056-3f79bed8a6f1 req-387c4188-5510-471f-a720-0c2b98cc1745 service nova] Creating event network-changed:fd0ac6a9-c23b-4d52-9aad-a28d1d316935 for instance 54723a9d-3cbe-4901-84fc-c0635a5f0f20 on hv-cinder-81901 Jan 25 03:37:39.430377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-c0d0b27c-1c07-4bf4-9056-3f79bed8a6f1 req-387c4188-5510-471f-a720-0c2b98cc1745 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052523 Jan 25 03:37:39.430983 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 267/456] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:39.853576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9b7de7a3-52ab-477f-b678-ddb9094d373b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:39.854752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9b7de7a3-52ab-477f-b678-ddb9094d373b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:39.864630 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b7de7a3-52ab-477f-b678-ddb9094d373b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:39.865245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b7de7a3-52ab-477f-b678-ddb9094d373b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:39.866539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b7de7a3-52ab-477f-b678-ddb9094d373b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:39.867110 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b7de7a3-52ab-477f-b678-ddb9094d373b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:39.906313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:39.908858 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:39.918604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:39.919441 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:39.920226 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:39.920864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:40.116584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:40.123937 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-deba6320-369a-4723-b01c-0156b84ceb69 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.227827 Jan 25 03:37:40.124590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 268/457] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:39 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:40.128955 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:40.129668 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:40.135295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:40.135929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:40.136730 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:40.137189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:40.339919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:40.364142 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9b7de7a3-52ab-477f-b678-ddb9094d373b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.515717 Jan 25 03:37:40.364824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 190/458] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:39 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:40.367876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0567e368-82c8-4c56-a546-f991c4a6bb18 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.242162 Jan 25 03:37:40.368457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 269/459] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:40 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:40.827852 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:40.828576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:40.869681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:40.869681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:40.869681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:40.869681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.141184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:41.148889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:41.148889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.148889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.149203 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.149459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.323948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:41.331400 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:41.332402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2bd31146-f7b7-4ca0-a097-8c4586287f04 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1521 microversion: 2.1 time: 0.509721 Jan 25 03:37:41.333064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 191/460] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:40 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:41.345988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b4e89d12-9595-4b8a-8654-94daf8246556 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1321 microversion: 2.1 time: 0.208934 Jan 25 03:37:41.349781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 270/461] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:41 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:41.349938 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-90e23de0-9dac-4657-8356-b04582b5a368 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a2b39bd-ecf3-4f17-9d1f-ce4114be8e1d"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:41.350052 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-90e23de0-9dac-4657-8356-b04582b5a368 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:41.357195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-90e23de0-9dac-4657-8356-b04582b5a368 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.357741 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-90e23de0-9dac-4657-8356-b04582b5a368 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.358526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-90e23de0-9dac-4657-8356-b04582b5a368 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.358956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-90e23de0-9dac-4657-8356-b04582b5a368 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.377126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-65d2a3c0-c79d-4423-a9c8-374a7737660f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:41.378110 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-65d2a3c0-c79d-4423-a9c8-374a7737660f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:41.384608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65d2a3c0-c79d-4423-a9c8-374a7737660f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.385152 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65d2a3c0-c79d-4423-a9c8-374a7737660f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.386721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65d2a3c0-c79d-4423-a9c8-374a7737660f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.387434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65d2a3c0-c79d-4423-a9c8-374a7737660f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.831076 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-65d2a3c0-c79d-4423-a9c8-374a7737660f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.457753 Jan 25 03:37:41.832128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 271/462] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:41 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:41.838079 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:41.839168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:41.847159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.847756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:41.848650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:41.849332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:42.049376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:42.065991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-30be2ff9-0482-4d6c-81f7-f4cb549a91d0 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.231906 Jan 25 03:37:42.066584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 272/463] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:41 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:42.253318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-90e23de0-9dac-4657-8356-b04582b5a368 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.907889 Jan 25 03:37:42.254549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 192/464] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:37:41 2022] POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:37:42.364168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:42.364846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:42.375143 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:42.381496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:42.381496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:42.381496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:42.553901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:42.571964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e06be710-1aeb-41b7-93bb-0cdf1e269a7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1511 microversion: 2.1 time: 0.209916 Jan 25 03:37:42.572565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 273/465] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:42 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:42.845270 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2efadc51-66a8-4b38-ba94-b088f1efab85 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:42.846579 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2efadc51-66a8-4b38-ba94-b088f1efab85 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:42.852804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2efadc51-66a8-4b38-ba94-b088f1efab85 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:42.853322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2efadc51-66a8-4b38-ba94-b088f1efab85 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:42.854307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2efadc51-66a8-4b38-ba94-b088f1efab85 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:42.854938 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2efadc51-66a8-4b38-ba94-b088f1efab85 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:42.948175 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2efadc51-66a8-4b38-ba94-b088f1efab85 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.108313 Jan 25 03:37:42.948890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 193/466] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:42 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:43.085123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:43.086085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:43.094473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:43.095342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:43.096150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:43.096687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:43.337604 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1533966105", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "53c1fc18-89c3-459d-a1e2-14cd4e6b342a"}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:43.368985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:43.378247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f8423fef-13c5-4aed-aa2d-379b4db15b22 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.298753 Jan 25 03:37:43.379609 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 274/467] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:43 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:43.435069 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] validate_networks() for [('53c1fc18-89c3-459d-a1e2-14cd4e6b342a', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:37:43.810677 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:37:43.811631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:37:43.812309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:37:43.812827 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:37:43.813451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:37:43.823416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:43.824101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:43.825551 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:43.826077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:43.844181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Getting quotas for project 669e86b55a1248009baefdb84c00453a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:37:43.848246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Getting quotas for user b59b37fe3f1244fe8be12a62c33f55e9 and project 669e86b55a1248009baefdb84c00453a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:37:43.859555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:37:43.861970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:37:43.961777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7349977d-14b3-40bf-847c-174eabb2687e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:43.963183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7349977d-14b3-40bf-847c-174eabb2687e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:43.970752 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7349977d-14b3-40bf-847c-174eabb2687e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:43.971253 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7349977d-14b3-40bf-847c-174eabb2687e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:43.972050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7349977d-14b3-40bf-847c-174eabb2687e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:43.972489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7349977d-14b3-40bf-847c-174eabb2687e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:44.070826 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8551fcfe-44f0-47cc-8cc1-21111c2a2ee7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.745022 Jan 25 03:37:44.072072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 194/468] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:37:43 2022] POST /compute/v2.1/servers => generated 382 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:37:44.082443 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-67b3fc72-1d3e-43fb-a942-6a8eb374e9b5 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:44.083207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-67b3fc72-1d3e-43fb-a942-6a8eb374e9b5 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:44.138604 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-67b3fc72-1d3e-43fb-a942-6a8eb374e9b5 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:44.145139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-67b3fc72-1d3e-43fb-a942-6a8eb374e9b5 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1223 microversion: 2.1 time: 0.066420 Jan 25 03:37:44.145722 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 195/469] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:44 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1223 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:44.179130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7349977d-14b3-40bf-847c-174eabb2687e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.222317 Jan 25 03:37:44.182377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 275/470] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:43 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:44.395007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:44.395652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:44.402365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:44.403378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:44.404604 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:44.405032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:44.570970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:44.580554 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-474c10bd-4ba3-40ae-aa8d-1398a6dd805c tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.189140 Jan 25 03:37:44.581133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 196/471] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:44 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:45.165175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5934c190-d045-443a-8442-ec63210d3a6e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:45.166024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5934c190-d045-443a-8442-ec63210d3a6e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:45.191160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-99c0b0ca-473d-4a21-8085-37ee14a27a34 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:45.192113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-99c0b0ca-473d-4a21-8085-37ee14a27a34 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:45.198278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99c0b0ca-473d-4a21-8085-37ee14a27a34 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:45.198725 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99c0b0ca-473d-4a21-8085-37ee14a27a34 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:45.200128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99c0b0ca-473d-4a21-8085-37ee14a27a34 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:45.200564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99c0b0ca-473d-4a21-8085-37ee14a27a34 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:45.222303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5934c190-d045-443a-8442-ec63210d3a6e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:45.229252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5934c190-d045-443a-8442-ec63210d3a6e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1223 microversion: 2.1 time: 0.070262 Jan 25 03:37:45.230609 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 276/472] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:45 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1223 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:45.277672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6fe566d8-28aa-4da6-8bd3-6c299dcd4d9f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08122b1a-d9c3-4063-8e2f-b89b93de7369"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:45.278851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6fe566d8-28aa-4da6-8bd3-6c299dcd4d9f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:45.285938 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fe566d8-28aa-4da6-8bd3-6c299dcd4d9f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:45.286312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fe566d8-28aa-4da6-8bd3-6c299dcd4d9f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:45.287126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fe566d8-28aa-4da6-8bd3-6c299dcd4d9f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:45.287574 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fe566d8-28aa-4da6-8bd3-6c299dcd4d9f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:45.336079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-99c0b0ca-473d-4a21-8085-37ee14a27a34 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.148363 Jan 25 03:37:45.336738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 197/473] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:45 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:45.597149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:45.597839 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:45.604769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:45.605214 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:45.606633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:45.607088 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:45.771593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:45.779571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-87b67e9b-44f9-410a-acc4-9216dfd38812 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.186347 Jan 25 03:37:45.780360 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 198/474] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:45 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:46.239163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6fe566d8-28aa-4da6-8bd3-6c299dcd4d9f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965703 Jan 25 03:37:46.239768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 277/475] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:37:45 2022] POST /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:46.245381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:46.249563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:46.256856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:46.257507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:46.258380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:46.258880 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:46.327354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:46.335130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-14c821af-a7b3-4da7-a12d-33a16d2a937d tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1275 microversion: 2.1 time: 0.093261 Jan 25 03:37:46.335717 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 199/476] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:46 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1275 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:46.354563 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ad249f39-48bf-4307-a709-841427c9a7fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:46.356234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ad249f39-48bf-4307-a709-841427c9a7fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:46.363503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad249f39-48bf-4307-a709-841427c9a7fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:46.364403 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad249f39-48bf-4307-a709-841427c9a7fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:46.365423 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad249f39-48bf-4307-a709-841427c9a7fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:46.365873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad249f39-48bf-4307-a709-841427c9a7fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:46.598437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ad249f39-48bf-4307-a709-841427c9a7fb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.253675 Jan 25 03:37:46.599133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 278/477] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:46 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:46.796398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:46.796998 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:46.803342 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:46.803723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:46.804513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:46.804939 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:47.037451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:47.047216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9b26bed5-8264-4822-9e12-083ae947002d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.254484 Jan 25 03:37:47.048033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 200/478] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:46 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:47.357729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:47.358763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:47.366670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:47.367164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:47.368126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:47.368721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:47.457230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:47.468897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-13f66a23-baca-4357-890e-4aa7e80ea82f tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1281 microversion: 2.1 time: 0.115174 Jan 25 03:37:47.469470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 279/479] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:47 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:47.609824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bc0d3f43-1864-4f61-a060-c1c26ec8c145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:47.610724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bc0d3f43-1864-4f61-a060-c1c26ec8c145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:47.617080 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc0d3f43-1864-4f61-a060-c1c26ec8c145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:47.617513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc0d3f43-1864-4f61-a060-c1c26ec8c145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:47.618271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc0d3f43-1864-4f61-a060-c1c26ec8c145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:47.618699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc0d3f43-1864-4f61-a060-c1c26ec8c145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:47.716975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bc0d3f43-1864-4f61-a060-c1c26ec8c145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.110865 Jan 25 03:37:47.717676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 201/480] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:47 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:48.065331 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:48.066264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:48.074022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:48.074022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:48.074288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:48.074584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:48.223604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:48.230918 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7d46391c-8dbc-4634-b057-e4ca263f600d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.169741 Jan 25 03:37:48.232331 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 280/481] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:48 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:48.491160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:48.491954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:48.499377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:48.500077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:48.500926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:48.501513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:48.677858 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-33120ba9-bc1e-4c6d-bdbd-804c5c5c292d req-6e2805d6-017f-44f9-b64c-3f3470f20279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17671564-7d41-4c30-b928-409b5a40f3a7", "tag": "2f6d88f6-f3ce-4d4e-b0c9-e5297f4479d9"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:48.679675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:48.679675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:37:48.689914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-33120ba9-bc1e-4c6d-bdbd-804c5c5c292d req-6e2805d6-017f-44f9-b64c-3f3470f20279 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:48.690569 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-33120ba9-bc1e-4c6d-bdbd-804c5c5c292d req-6e2805d6-017f-44f9-b64c-3f3470f20279 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:48.697082 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:48.705519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-33120ba9-bc1e-4c6d-bdbd-804c5c5c292d req-6e2805d6-017f-44f9-b64c-3f3470f20279 service nova] Creating event network-changed:2f6d88f6-f3ce-4d4e-b0c9-e5297f4479d9 for instance 17671564-7d41-4c30-b928-409b5a40f3a7 on hv-cinder-81901 Jan 25 03:37:48.707824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3720d962-194d-4eae-98c1-f10cbb18c48b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.224680 Jan 25 03:37:48.709130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 202/482] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:48 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:48.710616 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-33120ba9-bc1e-4c6d-bdbd-804c5c5c292d req-6e2805d6-017f-44f9-b64c-3f3470f20279 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037305 Jan 25 03:37:48.711424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 281/483] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:37:48.728626 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5593da86-4d3f-4ad7-be73-d03c6e6c99a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:48.729611 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5593da86-4d3f-4ad7-be73-d03c6e6c99a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:48.735349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5593da86-4d3f-4ad7-be73-d03c6e6c99a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:48.735792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5593da86-4d3f-4ad7-be73-d03c6e6c99a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:48.736558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5593da86-4d3f-4ad7-be73-d03c6e6c99a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:48.736987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5593da86-4d3f-4ad7-be73-d03c6e6c99a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:48.833239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5593da86-4d3f-4ad7-be73-d03c6e6c99a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.108008 Jan 25 03:37:48.833818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 203/484] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:48 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:49.086904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-bb370a3b-a294-4a2b-9959-f99b3b0dcd83 req-ae8522b3-b4f6-4675-8d73-7e5cafe42b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54723a9d-3cbe-4901-84fc-c0635a5f0f20", "name": "network-vif-plugged", "status": "completed", "tag": "fd0ac6a9-c23b-4d52-9aad-a28d1d316935"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:49.088449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:49.088449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:37:49.096229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-bb370a3b-a294-4a2b-9959-f99b3b0dcd83 req-ae8522b3-b4f6-4675-8d73-7e5cafe42b64 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:49.096682 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-bb370a3b-a294-4a2b-9959-f99b3b0dcd83 req-ae8522b3-b4f6-4675-8d73-7e5cafe42b64 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:49.107703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-bb370a3b-a294-4a2b-9959-f99b3b0dcd83 req-ae8522b3-b4f6-4675-8d73-7e5cafe42b64 service nova] Creating event network-vif-plugged:fd0ac6a9-c23b-4d52-9aad-a28d1d316935 for instance 54723a9d-3cbe-4901-84fc-c0635a5f0f20 on hv-cinder-81901 Jan 25 03:37:49.112466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-bb370a3b-a294-4a2b-9959-f99b3b0dcd83 req-ae8522b3-b4f6-4675-8d73-7e5cafe42b64 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029490 Jan 25 03:37:49.112959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 282/485] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:49.249625 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:49.250359 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:49.261550 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:49.262228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:49.263680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:49.264129 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:49.520973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:49.528300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d2819ea8-df57-431e-838d-c6c3747e996d tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.284001 Jan 25 03:37:49.528871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 204/486] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:49 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:49.727962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:49.728659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:49.735243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:49.735243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:49.735998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:49.736462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:49.845595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1f2d49cb-48d7-46cc-a52a-c3d502b12922 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:49.846513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1f2d49cb-48d7-46cc-a52a-c3d502b12922 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:49.852871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f2d49cb-48d7-46cc-a52a-c3d502b12922 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:49.853323 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f2d49cb-48d7-46cc-a52a-c3d502b12922 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:49.854099 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f2d49cb-48d7-46cc-a52a-c3d502b12922 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:49.854533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f2d49cb-48d7-46cc-a52a-c3d502b12922 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:49.870078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:49.878213 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ec79a870-6fca-40b9-8030-53c8b15e1f7c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.154628 Jan 25 03:37:49.878779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 283/487] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:49 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:50.242874 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1f2d49cb-48d7-46cc-a52a-c3d502b12922 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.401126 Jan 25 03:37:50.243568 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 205/488] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:49 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:50.544684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:50.545298 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:50.552601 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:50.553060 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:50.553884 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:50.554309 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:50.693075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:50.700804 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b9a0ea4b-e25d-4ce1-8272-232f39c30b00 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.159746 Jan 25 03:37:50.702081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 284/489] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:50 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:50.895288 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:50.895983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:50.903084 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:50.903612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:50.904660 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:50.905260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.044189 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:51.053094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e329100b-19fc-4fc0-8d78-6ba60c0352e9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.161935 Jan 25 03:37:51.053664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 206/490] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:50 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:51.068320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:51.069253 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:51.075808 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.076347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.077127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.077605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.100912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lazy-loading 'flavor' on Instance uuid 17d82b81-05dd-4075-8d84-577551c2a689 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:51.254136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-20b3a5a2-d791-4b99-8416-84d9f5adfc49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:51.255157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-20b3a5a2-d791-4b99-8416-84d9f5adfc49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:51.261486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20b3a5a2-d791-4b99-8416-84d9f5adfc49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.261849 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20b3a5a2-d791-4b99-8416-84d9f5adfc49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.262615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20b3a5a2-d791-4b99-8416-84d9f5adfc49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.263041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20b3a5a2-d791-4b99-8416-84d9f5adfc49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.388488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-20b3a5a2-d791-4b99-8416-84d9f5adfc49 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.138123 Jan 25 03:37:51.389461 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 207/491] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:51 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:51.719364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:51.720072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:51.727026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.727545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.728328 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.728772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.809520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9b42d3f7-91c0-4817-9ddd-1cd4fa3b654b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action" status: 200 len: 32 microversion: 2.1 time: 0.744920 Jan 25 03:37:51.810231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 285/492] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:37:51 2022] POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action => generated 32 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:37:51.825132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:51.825700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:51.835663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.836103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.837252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:51.837363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:51.909525 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:51.919821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4a29aa21-41bd-4037-a823-4662925d09b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1317 microversion: 2.1 time: 0.203806 Jan 25 03:37:51.920745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 208/493] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:51 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:52.039959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:52.053482 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bf874eb4-884b-4fcc-a569-80a3e016bb2c tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.232491 Jan 25 03:37:52.054722 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 286/494] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:51 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:52.077121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:52.078014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:52.085302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:52.085825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:52.086699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:52.087229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:52.301098 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:52.309030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4b878870-1b10-486b-9b24-0abc4c9192a6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.237515 Jan 25 03:37:52.309824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 209/495] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:52 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:52.401483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c9c4589e-38a6-4b8d-af86-64041c31c9c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:52.402007 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c9c4589e-38a6-4b8d-af86-64041c31c9c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:52.422135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9c4589e-38a6-4b8d-af86-64041c31c9c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:52.422135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9c4589e-38a6-4b8d-af86-64041c31c9c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:52.422135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9c4589e-38a6-4b8d-af86-64041c31c9c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:52.422135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c9c4589e-38a6-4b8d-af86-64041c31c9c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:52.535246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c9c4589e-38a6-4b8d-af86-64041c31c9c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.138207 Jan 25 03:37:52.536288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 287/496] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:52 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:52.936544 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:52.937168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:52.943453 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:52.943925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:52.944826 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:52.945174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:53.072094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:53.072792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:53.080234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:53.083676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:53.083676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:53.083676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:53.085129 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:53.093562 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f18a36f0-c4e6-4dda-9942-d85bc672a421 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1501 microversion: 2.1 time: 0.160866 Jan 25 03:37:53.094145 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 210/497] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:52 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:53.213226 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:53.223323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c4379a73-0bfb-45d4-9a8b-1e6fdcfe3f32 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.155392 Jan 25 03:37:53.225193 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 288/498] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:53 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:53.327246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:53.327902 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:53.333993 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:53.334452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:53.335286 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:53.335726 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:53.485772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:53.493560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b0f765cd-1a5e-45d0-b335-894eb23cfdce tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.170807 Jan 25 03:37:53.494615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 211/499] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:53 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:53.555044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3cc07712-6679-457f-8dcb-8aedc97b5fd9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:53.555044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3cc07712-6679-457f-8dcb-8aedc97b5fd9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:53.556141 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc07712-6679-457f-8dcb-8aedc97b5fd9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:53.557009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc07712-6679-457f-8dcb-8aedc97b5fd9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:53.557984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc07712-6679-457f-8dcb-8aedc97b5fd9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:53.558494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc07712-6679-457f-8dcb-8aedc97b5fd9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:53.675723 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3cc07712-6679-457f-8dcb-8aedc97b5fd9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.132035 Jan 25 03:37:53.676476 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 289/500] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:53 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:54.053002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:54.053574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:54.059522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.059970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.061409 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.062157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.103482 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:37:54.243192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:54.243819 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:54.251294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.252160 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.252578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.253041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.342961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1fe28fb0-c12f-49f8-a789-8cd217f027f5 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "DELETE /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 204 len: 0 microversion: 2.1 time: 0.293144 Jan 25 03:37:54.343575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 212/501] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:37:54 2022] DELETE /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:37:54.358164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:54.359395 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:54.367305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.371700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.384207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.384790 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.456886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:54.464861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-97a3a295-aedb-4a9e-ba57-de4076baab41 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.226183 Jan 25 03:37:54.465944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 290/502] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:54 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:54.511292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:54.511882 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:54.519350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.530989 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.530989 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.530989 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.670111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:54.677892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4a6fb51a-d578-4924-bd19-957ea766303e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.170485 Jan 25 03:37:54.678475 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 291/503] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:54 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:54.688416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a7ba4853-a3e5-41c7-b4d0-9bce64d43912 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:54.692722 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a7ba4853-a3e5-41c7-b4d0-9bce64d43912 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:54.695550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7ba4853-a3e5-41c7-b4d0-9bce64d43912 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.696258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7ba4853-a3e5-41c7-b4d0-9bce64d43912 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.697044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7ba4853-a3e5-41c7-b4d0-9bce64d43912 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:54.697482 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7ba4853-a3e5-41c7-b4d0-9bce64d43912 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:54.809526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:54.812016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a7ba4853-a3e5-41c7-b4d0-9bce64d43912 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.127133 Jan 25 03:37:54.812881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 292/504] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:54 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:54.817715 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-16fba0c0-e82e-4712-84ec-975039847927 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1507 microversion: 2.1 time: 0.469064 Jan 25 03:37:54.818282 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 213/505] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:54 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:55.482940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:55.483709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:55.490677 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.491251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:55.492680 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.493133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:55.690803 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:55.696812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:55.698445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:55.703906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-73bfd8bb-e1d0-47f4-be14-bebb38489976 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.225155 Jan 25 03:37:55.704555 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 293/506] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:55 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:55.707455 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.707950 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:55.708713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.709303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:55.824431 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-849681f5-21ee-4b54-943f-2e81f07cf196 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:55.825259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-849681f5-21ee-4b54-943f-2e81f07cf196 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:55.837275 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-849681f5-21ee-4b54-943f-2e81f07cf196 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.837729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-849681f5-21ee-4b54-943f-2e81f07cf196 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:55.838523 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-849681f5-21ee-4b54-943f-2e81f07cf196 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.838956 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-849681f5-21ee-4b54-943f-2e81f07cf196 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:55.872398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:55.881958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-57b7f226-452e-44c4-9082-e3792b961496 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.190526 Jan 25 03:37:55.882911 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 214/507] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:55 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:55.887625 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:55.889369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:55.895825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.896282 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:55.897250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:55.897705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:56.021242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-849681f5-21ee-4b54-943f-2e81f07cf196 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.200663 Jan 25 03:37:56.021902 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 294/508] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:55 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:56.054821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:56.064579 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6e56adc3-bcca-4b70-b7cf-a2bb9e9146a1 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1507 microversion: 2.1 time: 0.179205 Jan 25 03:37:56.064795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 215/509] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:55 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:56.720917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:56.721680 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:56.729299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:56.730064 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:56.730943 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:56.731384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:56.899096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:56.900275 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:56.906953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:56.907676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:56.908468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:56.908893 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:56.936800 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:56.947629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ab7875aa-1fc4-434e-a6ef-02fba997f863 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.230843 Jan 25 03:37:56.952653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 295/510] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:56 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:57.043643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-885bb499-4975-4974-83e4-bda540be0b62 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:57.043643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-885bb499-4975-4974-83e4-bda540be0b62 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:57.043643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-885bb499-4975-4974-83e4-bda540be0b62 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:57.043974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-885bb499-4975-4974-83e4-bda540be0b62 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:57.061286 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-885bb499-4975-4974-83e4-bda540be0b62 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:57.061286 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-885bb499-4975-4974-83e4-bda540be0b62 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:57.173966 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-885bb499-4975-4974-83e4-bda540be0b62 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.144273 Jan 25 03:37:57.174722 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 296/511] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:57 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:57.180248 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:57.180941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:57.188442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:57.188442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:57.189212 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:57.189640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:57.209755 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:57.218443 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-24898829-6a33-4584-9de7-70ca0b7b9b99 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.322904 Jan 25 03:37:57.219525 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 216/512] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:56 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:57.325650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:57.333679 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ae6a9763-5cba-4d86-835b-828c466634f8 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1507 microversion: 2.1 time: 0.157196 Jan 25 03:37:57.334394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 297/513] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:57 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:57.430580 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-ac0bff4d-05dc-49b9-bf07-568dab6fde43 req-c3f60d1a-5c10-4ddf-acc7-4a8a92ece47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54723a9d-3cbe-4901-84fc-c0635a5f0f20", "name": "network-vif-deleted", "tag": "fd0ac6a9-c23b-4d52-9aad-a28d1d316935"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:57.432215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:57.432215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:37:57.443256 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ac0bff4d-05dc-49b9-bf07-568dab6fde43 req-c3f60d1a-5c10-4ddf-acc7-4a8a92ece47a service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:57.443256 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ac0bff4d-05dc-49b9-bf07-568dab6fde43 req-c3f60d1a-5c10-4ddf-acc7-4a8a92ece47a service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:57.452184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-ac0bff4d-05dc-49b9-bf07-568dab6fde43 req-c3f60d1a-5c10-4ddf-acc7-4a8a92ece47a service nova] Creating event network-vif-deleted:fd0ac6a9-c23b-4d52-9aad-a28d1d316935 for instance 54723a9d-3cbe-4901-84fc-c0635a5f0f20 on hv-cinder-81901 Jan 25 03:37:57.456983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-ac0bff4d-05dc-49b9-bf07-568dab6fde43 req-c3f60d1a-5c10-4ddf-acc7-4a8a92ece47a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030065 Jan 25 03:37:57.457577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 217/514] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:57.965135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:57.965748 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:57.975030 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:57.976052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:57.977070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:57.978391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.176749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:58.180786 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b311821a-9913-4f3d-87fa-8ff67e986f7f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.219504 Jan 25 03:37:58.181463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 298/515] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:57 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:58.189633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fedef1ec-2ef7-46a4-a7f1-d7b7d2ce41e4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:58.192241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fedef1ec-2ef7-46a4-a7f1-d7b7d2ce41e4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:58.202104 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fedef1ec-2ef7-46a4-a7f1-d7b7d2ce41e4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:58.206997 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fedef1ec-2ef7-46a4-a7f1-d7b7d2ce41e4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.208433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fedef1ec-2ef7-46a4-a7f1-d7b7d2ce41e4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:58.209135 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fedef1ec-2ef7-46a4-a7f1-d7b7d2ce41e4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.236313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:58.237451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:58.244878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:58.246954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.248195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:58.248749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.328710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fedef1ec-2ef7-46a4-a7f1-d7b7d2ce41e4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.139469 Jan 25 03:37:58.328710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 218/516] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:58 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:58.363904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:58.365488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:58.408555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:58.408555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.409989 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:58.411327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.435471 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:58.444267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e9b66635-29a0-46c9-82c0-48661b370d9c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.212692 Jan 25 03:37:58.447103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 299/517] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:58 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:58.457126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:58.457610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:58.458144 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lazy-loading 'fault' on Instance uuid 54723a9d-3cbe-4901-84fc-c0635a5f0f20 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:58.505680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9244d123024af08f3e75c09a5b586b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9572dffe747a4371ace5d887368ca64b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:58.514710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e3bcfbec-558d-47a0-98e7-e0da37edb9b7 tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 200 len: 1307 microversion: 2.1 time: 0.166967 Jan 25 03:37:58.516054 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 219/518] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:58 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 1307 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:59.187877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08122b1a-d9c3-4063-8e2f-b89b93de7369"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:59.189051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:59.195754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.196678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.197464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.197899 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.197998 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:59.198526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:59.217232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.217698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.218492 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.219152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.289227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] HTTP exception thrown: Invalid volume: volume 08122b1a-d9c3-4063-8e2f-b89b93de7369 is already attached to instances: 9c1b7caf-2414-4373-a49c-b8374358d3f3 Jan 25 03:37:59.289828 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Returning 400 to user: Invalid volume: volume 08122b1a-d9c3-4063-8e2f-b89b93de7369 is already attached to instances: 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:59.290659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c08d78e1-3cee-4b29-b9c5-afd58d35a947 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107766 Jan 25 03:37:59.291401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 300/519] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:37:59 2022] POST /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:37:59.296649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-dd06ed0a-e0d5-4fd8-8e8d-d71b7dc107fd req-7dad6d57-0716-4c42-afb7-c02f529fd883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17671564-7d41-4c30-b928-409b5a40f3a7", "name": "network-vif-plugged", "status": "completed", "tag": "2f6d88f6-f3ce-4d4e-b0c9-e5297f4479d9"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:59.298454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:37:59.298454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:37:59.306300 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-dd06ed0a-e0d5-4fd8-8e8d-d71b7dc107fd req-7dad6d57-0716-4c42-afb7-c02f529fd883 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.306911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-dd06ed0a-e0d5-4fd8-8e8d-d71b7dc107fd req-7dad6d57-0716-4c42-afb7-c02f529fd883 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.318937 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-dd06ed0a-e0d5-4fd8-8e8d-d71b7dc107fd req-7dad6d57-0716-4c42-afb7-c02f529fd883 service nova] Creating event network-vif-plugged:2f6d88f6-f3ce-4d4e-b0c9-e5297f4479d9 for instance 17671564-7d41-4c30-b928-409b5a40f3a7 on hv-cinder-81901 Jan 25 03:37:59.325524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-dd06ed0a-e0d5-4fd8-8e8d-d71b7dc107fd req-7dad6d57-0716-4c42-afb7-c02f529fd883 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032901 Jan 25 03:37:59.326310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 301/520] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:37:59.339686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6d932f9c-924e-4a62-aa67-4b173b4b4dd7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:37:59.340690 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6d932f9c-924e-4a62-aa67-4b173b4b4dd7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:59.352811 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d932f9c-924e-4a62-aa67-4b173b4b4dd7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.354306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d932f9c-924e-4a62-aa67-4b173b4b4dd7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.356184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d932f9c-924e-4a62-aa67-4b173b4b4dd7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.356288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d932f9c-924e-4a62-aa67-4b173b4b4dd7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.445725 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:59.454001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-02cb209b-845b-4239-a083-697f36927d36 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.260064 Jan 25 03:37:59.455568 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 220/521] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:59 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:37:59.460307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:59.461270 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:59.468390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.468838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.469612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.470191 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.501792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6d932f9c-924e-4a62-aa67-4b173b4b4dd7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.167322 Jan 25 03:37:59.509274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 302/522] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:37:59 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:37:59.509274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:59.509274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:59.515771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.516226 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.517027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.517448 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.612626 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'services' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:37:59.680550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:37:59.691050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1ca77cb4-e0e1-4ca8-8585-7815e3fa4805 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.185612 Jan 25 03:37:59.693093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 303/523] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:59 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:37:59.698117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:59.698731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] [instance: 54723a9d-3cbe-4901-84fc-c0635a5f0f20] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:59.704894 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.705527 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.706319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.708301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.726040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] HTTP exception thrown: Instance 54723a9d-3cbe-4901-84fc-c0635a5f0f20 could not be found. Jan 25 03:37:59.726871 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] Returning 404 to user: Instance 54723a9d-3cbe-4901-84fc-c0635a5f0f20 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:37:59.727891 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-aac576e9-9988-4d98-a48d-11d73b5976dd tempest-VolumesActionsTest-1949965932 tempest-VolumesActionsTest-1949965932-project] 10.222.0.115 "GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20" status: 404 len: 111 microversion: 2.1 time: 0.033595 Jan 25 03:37:59.728618 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 304/524] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:37:59 2022] GET /compute/v2.1/servers/54723a9d-3cbe-4901-84fc-c0635a5f0f20 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:37:59.918543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-efb7c0e9-e19f-454b-9c6e-25961d08cab6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments/08122b1a-d9c3-4063-8e2f-b89b93de7369" status: 202 len: 0 microversion: 2.1 time: 0.461498 Jan 25 03:37:59.919142 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 221/525] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:37:59 2022] DELETE /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments/08122b1a-d9c3-4063-8e2f-b89b93de7369 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:37:59.927418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-14115af6-45c9-4eed-b0b0-5adbe694cf2c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:37:59.928362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-14115af6-45c9-4eed-b0b0-5adbe694cf2c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:37:59.934642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14115af6-45c9-4eed-b0b0-5adbe694cf2c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.935181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14115af6-45c9-4eed-b0b0-5adbe694cf2c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.936163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14115af6-45c9-4eed-b0b0-5adbe694cf2c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:37:59.940210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14115af6-45c9-4eed-b0b0-5adbe694cf2c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:37:59.970324 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-14115af6-45c9-4eed-b0b0-5adbe694cf2c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Jan 25 03:37:59.970895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 305/526] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:37:59 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:00.477078 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:00.482924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:00.484616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.485071 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:00.486055 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.486500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:00.517009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9c0d7b31-4730-4a4c-8292-804e99ceb672 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:00.523032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9c0d7b31-4730-4a4c-8292-804e99ceb672 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:00.524784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9c0d7b31-4730-4a4c-8292-804e99ceb672 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.525240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9c0d7b31-4730-4a4c-8292-804e99ceb672 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:00.526023 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9c0d7b31-4730-4a4c-8292-804e99ceb672 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.526459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9c0d7b31-4730-4a4c-8292-804e99ceb672 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:00.618667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:00.628316 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5e2ac183-a412-4de8-93c3-933bd5a5e7be tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.155307 Jan 25 03:38:00.629194 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 222/527] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:00 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:00.639731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9c0d7b31-4730-4a4c-8292-804e99ceb672 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.126344 Jan 25 03:38:00.641439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 306/528] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:00 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:00.708968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:00.710015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:00.715876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.716645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:00.717456 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.717877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:00.881735 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:00.889993 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cbb52d60-a16c-41cf-8795-19ab15ce44d2 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1323 microversion: 2.1 time: 0.184926 Jan 25 03:38:00.890863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 223/529] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:00 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:00.983291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c1fb662d-7cec-464b-b353-9664b8f45cc7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:00.985544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c1fb662d-7cec-464b-b353-9664b8f45cc7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:00.992244 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1fb662d-7cec-464b-b353-9664b8f45cc7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.992985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1fb662d-7cec-464b-b353-9664b8f45cc7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:00.993972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1fb662d-7cec-464b-b353-9664b8f45cc7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:00.994500 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1fb662d-7cec-464b-b353-9664b8f45cc7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:01.027155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c1fb662d-7cec-464b-b353-9664b8f45cc7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048916 Jan 25 03:38:01.027728 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 307/530] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:00 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:01.647274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:01.647885 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:01.650770 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-054610f3-1d62-4b34-ab7d-524ece093b4b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:01.651714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-054610f3-1d62-4b34-ab7d-524ece093b4b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:01.654322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:01.654772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:01.655844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:01.656286 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:01.658521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-054610f3-1d62-4b34-ab7d-524ece093b4b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:01.658983 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-054610f3-1d62-4b34-ab7d-524ece093b4b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:01.659842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-054610f3-1d62-4b34-ab7d-524ece093b4b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:01.660281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-054610f3-1d62-4b34-ab7d-524ece093b4b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:01.764612 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-054610f3-1d62-4b34-ab7d-524ece093b4b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.117330 Jan 25 03:38:01.767975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 308/531] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:01 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:01.793135 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:01.801111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e4e3ed44-619d-4ac1-b031-e1f4987e51ab tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.157490 Jan 25 03:38:01.801680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 224/532] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:01 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:01.907808 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:01.908515 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:01.915735 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:01.916185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:01.917124 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:01.917842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:02.039243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e7d5ce20-8f99-4b0b-8cdc-3dfd31bf0fe9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:02.040311 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e7d5ce20-8f99-4b0b-8cdc-3dfd31bf0fe9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:02.046662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7d5ce20-8f99-4b0b-8cdc-3dfd31bf0fe9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:02.047153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7d5ce20-8f99-4b0b-8cdc-3dfd31bf0fe9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:02.047948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7d5ce20-8f99-4b0b-8cdc-3dfd31bf0fe9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:02.048383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7d5ce20-8f99-4b0b-8cdc-3dfd31bf0fe9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:02.057893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:02.066116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-19c27d1c-1f35-46f8-a8f0-3c8402403a3c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1512 microversion: 2.1 time: 0.162463 Jan 25 03:38:02.066686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 309/533] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:01 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:02.078592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e7d5ce20-8f99-4b0b-8cdc-3dfd31bf0fe9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043076 Jan 25 03:38:02.086521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 225/534] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:02 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:38:02.783927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-052b1c12-6708-4c16-93f5-53c4da7f3377 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:02.784945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-052b1c12-6708-4c16-93f5-53c4da7f3377 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:02.791949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-052b1c12-6708-4c16-93f5-53c4da7f3377 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:02.792709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-052b1c12-6708-4c16-93f5-53c4da7f3377 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:02.794063 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-052b1c12-6708-4c16-93f5-53c4da7f3377 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:02.794741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-052b1c12-6708-4c16-93f5-53c4da7f3377 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:02.821124 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:02.822390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:02.830563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:02.831141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:02.832207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:02.832718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:03.036766 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:03.045355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-64155314-8e47-40c5-bca1-a6dc46b948bd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.230195 Jan 25 03:38:03.046113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 226/535] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:02 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:03.096477 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-62483259-366b-4b80-b0a4-7d6394e17d35 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:03.097654 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-62483259-366b-4b80-b0a4-7d6394e17d35 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:03.103994 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62483259-366b-4b80-b0a4-7d6394e17d35 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:03.104486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62483259-366b-4b80-b0a4-7d6394e17d35 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:03.105275 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62483259-366b-4b80-b0a4-7d6394e17d35 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:03.105707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62483259-366b-4b80-b0a4-7d6394e17d35 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:03.135366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-62483259-366b-4b80-b0a4-7d6394e17d35 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042790 Jan 25 03:38:03.136189 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 227/536] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:03 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:04.061691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:04.062302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:04.068486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:04.068939 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:04.069715 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:04.070153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:04.200314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:04.208558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-70317d5d-8364-4719-a1a8-82d0ac7aa1f8 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.150684 Jan 25 03:38:04.209156 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 228/537] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:04 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:04.213580 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-eab1c798-728e-4bd3-ab3b-33ae992bb00a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:04.214471 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-eab1c798-728e-4bd3-ab3b-33ae992bb00a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:04.221281 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eab1c798-728e-4bd3-ab3b-33ae992bb00a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:04.221735 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eab1c798-728e-4bd3-ab3b-33ae992bb00a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:04.222516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eab1c798-728e-4bd3-ab3b-33ae992bb00a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:04.222969 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eab1c798-728e-4bd3-ab3b-33ae992bb00a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:04.251533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-eab1c798-728e-4bd3-ab3b-33ae992bb00a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041350 Jan 25 03:38:04.252094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 229/538] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:04 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:05.228064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:05.228668 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:05.235045 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:05.235551 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:05.236361 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:05.236804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:05.366088 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:05.374818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-31ca17bc-2ad8-4b30-aa43-969ee888e0dd tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.150338 Jan 25 03:38:05.375441 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 230/539] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:05 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:05.379787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8e936687-3bc1-4b3b-ae87-ede092d4a697 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:05.380679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8e936687-3bc1-4b3b-ae87-ede092d4a697 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:05.386520 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e936687-3bc1-4b3b-ae87-ede092d4a697 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:05.386975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e936687-3bc1-4b3b-ae87-ede092d4a697 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:05.387783 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e936687-3bc1-4b3b-ae87-ede092d4a697 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:05.388787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e936687-3bc1-4b3b-ae87-ede092d4a697 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:05.422835 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8e936687-3bc1-4b3b-ae87-ede092d4a697 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 Jan 25 03:38:05.423140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 231/540] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:05 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:06.289762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-052b1c12-6708-4c16-93f5-53c4da7f3377 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 3.510970 Jan 25 03:38:06.290523 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 310/541] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:02 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 3513 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:06.392463 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:06.393069 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:06.399458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:06.399914 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:06.400723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:06.401164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:06.436732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f8e7741c-c114-4bb1-be97-e9c2b513b303 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:06.438163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f8e7741c-c114-4bb1-be97-e9c2b513b303 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:06.446274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e7741c-c114-4bb1-be97-e9c2b513b303 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:06.446888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e7741c-c114-4bb1-be97-e9c2b513b303 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:06.447807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e7741c-c114-4bb1-be97-e9c2b513b303 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:06.448545 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e7741c-c114-4bb1-be97-e9c2b513b303 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:06.493662 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f8e7741c-c114-4bb1-be97-e9c2b513b303 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062297 Jan 25 03:38:06.494350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 311/542] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:06 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:06.556798 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:06.565672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b51e668f-26ff-4517-8ca0-096e2db51a64 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.177597 Jan 25 03:38:06.566349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 232/543] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:06 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:07.301665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b9c6054b-45bb-4714-aeba-ba8d69eeaf68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:07.302586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b9c6054b-45bb-4714-aeba-ba8d69eeaf68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:07.309049 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9c6054b-45bb-4714-aeba-ba8d69eeaf68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:07.309506 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9c6054b-45bb-4714-aeba-ba8d69eeaf68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:07.310745 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9c6054b-45bb-4714-aeba-ba8d69eeaf68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:07.311215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9c6054b-45bb-4714-aeba-ba8d69eeaf68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:07.435874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b9c6054b-45bb-4714-aeba-ba8d69eeaf68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.137779 Jan 25 03:38:07.436516 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 312/544] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:07 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:07.506266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-447c681c-1fb8-4987-b9ba-5d014e8109ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:07.513499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-447c681c-1fb8-4987-b9ba-5d014e8109ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:07.514821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447c681c-1fb8-4987-b9ba-5d014e8109ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:07.515308 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447c681c-1fb8-4987-b9ba-5d014e8109ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:07.516250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447c681c-1fb8-4987-b9ba-5d014e8109ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:07.516685 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-447c681c-1fb8-4987-b9ba-5d014e8109ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:07.547862 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-447c681c-1fb8-4987-b9ba-5d014e8109ca tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045548 Jan 25 03:38:07.553333 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 233/545] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:07 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:38:07.584010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:07.584949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:07.592434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:07.593297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:07.594504 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:07.595038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:07.713991 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1353662630", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "835e181b-635d-41dd-9269-42b6c17d0334"}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:07.734596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:07.742772 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-735cdb44-0448-43e4-9f33-335f999c461b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.162854 Jan 25 03:38:07.750296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 313/546] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:07 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:07.778500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] validate_networks() for [('835e181b-635d-41dd-9269-42b6c17d0334', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:38:08.155415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:38:08.155652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:38:08.156161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:38:08.156844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:38:08.157312 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:38:08.165877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:08.166325 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:08.167334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:08.167765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:08.186795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:38:08.190706 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Getting quotas for user 66a4cd3a6bc441d8b1d4bfdd15a6402d and project 2e67c9d0a7f44900a2ac9fdc1bdcb15a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:38:08.201791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:38:08.204121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:38:08.321178 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0eb85627-a843-487f-8273-0f2bd1596950 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.610466 Jan 25 03:38:08.321834 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 234/547] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:38:07 2022] POST /compute/v2.1/servers => generated 382 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:38:08.332949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-cdb492a4-f8d3-4473-8ac9-a2b7a3314d9e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:08.333714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-cdb492a4-f8d3-4473-8ac9-a2b7a3314d9e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:08.391790 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-cdb492a4-f8d3-4473-8ac9-a2b7a3314d9e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:08.400621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-cdb492a4-f8d3-4473-8ac9-a2b7a3314d9e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1222 microversion: 2.1 time: 0.072695 Jan 25 03:38:08.401202 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 314/548] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:08 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:08.447710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-44e102bc-990b-4446-a3d3-a24fdea409a0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:08.448694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-44e102bc-990b-4446-a3d3-a24fdea409a0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:08.455714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44e102bc-990b-4446-a3d3-a24fdea409a0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:08.456271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44e102bc-990b-4446-a3d3-a24fdea409a0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:08.457119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44e102bc-990b-4446-a3d3-a24fdea409a0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:08.457653 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44e102bc-990b-4446-a3d3-a24fdea409a0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:08.572804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-44e102bc-990b-4446-a3d3-a24fdea409a0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.128834 Jan 25 03:38:08.576915 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 235/549] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:08 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:08.760962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:08.763292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:08.768980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:08.769445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:08.770256 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:08.770696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:08.961632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:08.978291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-498dc79b-0433-4621-87c5-f62eaff22c3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.221006 Jan 25 03:38:08.979626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 315/550] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:08 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:09.418295 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:09.418994 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:09.426492 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:09.426921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:09.431479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:09.431479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:09.490871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:09.499582 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8b52e476-c9f4-4ef2-900e-e967bf92e1ea tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1226 microversion: 2.1 time: 0.085597 Jan 25 03:38:09.500150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 236/551] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:09 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:09.585223 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7a70d036-99ee-4aa4-88f5-c205ef835bdc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:09.586579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7a70d036-99ee-4aa4-88f5-c205ef835bdc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:09.596909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a70d036-99ee-4aa4-88f5-c205ef835bdc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:09.597644 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a70d036-99ee-4aa4-88f5-c205ef835bdc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:09.599172 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a70d036-99ee-4aa4-88f5-c205ef835bdc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:09.599612 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a70d036-99ee-4aa4-88f5-c205ef835bdc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:09.700791 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7a70d036-99ee-4aa4-88f5-c205ef835bdc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.119508 Jan 25 03:38:09.701440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 316/552] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:09 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:09.997543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:09.998184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:10.004486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:10.004931 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:10.005710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:10.006141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:10.144573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:10.159832 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f876db17-30af-453a-b9ee-f0442e2955c9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.165313 Jan 25 03:38:10.160818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 237/553] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:09 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:10.518926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:10.520017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:10.529632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:10.530539 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:10.531370 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:10.532215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:10.602889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:10.616757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-10172ffb-013b-4e1a-9a55-1f85693f0a8f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1274 microversion: 2.1 time: 0.102065 Jan 25 03:38:10.618793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 317/554] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:10 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:10.714038 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-61dff050-02b5-4898-8544-9e384023b8a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:10.715429 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-61dff050-02b5-4898-8544-9e384023b8a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:10.726606 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61dff050-02b5-4898-8544-9e384023b8a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:10.727640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61dff050-02b5-4898-8544-9e384023b8a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:10.728672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61dff050-02b5-4898-8544-9e384023b8a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:10.729382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61dff050-02b5-4898-8544-9e384023b8a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:10.871362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-61dff050-02b5-4898-8544-9e384023b8a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.161486 Jan 25 03:38:10.873142 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 238/555] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:10 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:11.179051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:11.180825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:11.194743 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:11.194743 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:11.198225 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:11.198726 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:11.348099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:11.357063 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-555d425d-125d-48e2-9dfa-80cb405c9dd1 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.182140 Jan 25 03:38:11.357634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 318/556] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:11 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:11.647970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:11.648957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:11.657626 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:11.658092 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:11.659124 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:11.659724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:11.886832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ab4bda51-d0e1-417e-a2da-da4abd4bda2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:11.888418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ab4bda51-d0e1-417e-a2da-da4abd4bda2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:11.910647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab4bda51-d0e1-417e-a2da-da4abd4bda2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:11.912367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab4bda51-d0e1-417e-a2da-da4abd4bda2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:11.912367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab4bda51-d0e1-417e-a2da-da4abd4bda2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:11.912367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab4bda51-d0e1-417e-a2da-da4abd4bda2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:12.062280 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ab4bda51-d0e1-417e-a2da-da4abd4bda2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.180403 Jan 25 03:38:12.063359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 319/557] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:11 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:12.241128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:12.249236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b2d94ef0-32eb-4194-9704-8e1ec1ae6307 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.616289 Jan 25 03:38:12.249815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 239/558] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:11 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:12.375423 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:12.376142 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:12.384664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:12.388275 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:12.389369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:12.390760 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:12.597252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:12.608650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2f6d8eab-6953-4dd2-afa5-eb21dab46c07 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.238246 Jan 25 03:38:12.619212 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 320/559] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:12 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:13.074812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-48033a1b-cecb-4d94-bbae-f9a3fe60a1b3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:13.077348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-48033a1b-cecb-4d94-bbae-f9a3fe60a1b3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:13.086555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-48033a1b-cecb-4d94-bbae-f9a3fe60a1b3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:13.087265 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-48033a1b-cecb-4d94-bbae-f9a3fe60a1b3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:13.088284 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-48033a1b-cecb-4d94-bbae-f9a3fe60a1b3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:13.088939 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-48033a1b-cecb-4d94-bbae-f9a3fe60a1b3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:13.170721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-ab7dd1e1-a81b-4347-ab0b-7e0c4f2e3d0a req-60955534-4471-4e9a-a81a-e9fe947a6b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe745e9c-07ae-4b28-a900-c80c2483da22", "tag": "4fb97a43-a6b7-44dd-bde5-dba0bb60c4f0"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:13.172394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:38:13.172394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:38:13.196759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-ab7dd1e1-a81b-4347-ab0b-7e0c4f2e3d0a req-60955534-4471-4e9a-a81a-e9fe947a6b38 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:13.197247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-ab7dd1e1-a81b-4347-ab0b-7e0c4f2e3d0a req-60955534-4471-4e9a-a81a-e9fe947a6b38 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:13.205974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-48033a1b-cecb-4d94-bbae-f9a3fe60a1b3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.135404 Jan 25 03:38:13.206622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 240/560] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:13 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:13.246683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-ab7dd1e1-a81b-4347-ab0b-7e0c4f2e3d0a req-60955534-4471-4e9a-a81a-e9fe947a6b38 service nova] Creating event network-changed:4fb97a43-a6b7-44dd-bde5-dba0bb60c4f0 for instance fe745e9c-07ae-4b28-a900-c80c2483da22 on hv-cinder-81901 Jan 25 03:38:13.252535 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-ab7dd1e1-a81b-4347-ab0b-7e0c4f2e3d0a req-60955534-4471-4e9a-a81a-e9fe947a6b38 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086608 Jan 25 03:38:13.253134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 321/561] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:13.267266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:13.267849 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:13.278879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:13.282592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:13.282592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:13.282592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:13.536005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:13.542896 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a2822c8a-76d5-4127-a1f3-1d3861f69293 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.280818 Jan 25 03:38:13.552355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 241/562] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:13 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:13.627485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:13.628238 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:13.636131 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:13.638489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:13.640305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:13.642779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:13.828637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:13.838601 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4e7cb199-8780-47de-9d46-716982bf648d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.216525 Jan 25 03:38:13.839510 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 322/563] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:13 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:14.220174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f32e5625-cd07-44e1-98bd-87c500f7ef75 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:14.221830 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f32e5625-cd07-44e1-98bd-87c500f7ef75 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:14.230543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f32e5625-cd07-44e1-98bd-87c500f7ef75 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:14.232156 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f32e5625-cd07-44e1-98bd-87c500f7ef75 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:14.233198 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f32e5625-cd07-44e1-98bd-87c500f7ef75 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:14.234210 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f32e5625-cd07-44e1-98bd-87c500f7ef75 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:14.363630 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f32e5625-cd07-44e1-98bd-87c500f7ef75 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.149108 Jan 25 03:38:14.364294 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 242/564] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:14 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:14.561094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:14.561763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:14.569027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:14.572925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:14.572925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:14.572925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:14.770536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:14.778912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-33654a49-4c40-448f-b7c8-542a467d6675 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.222316 Jan 25 03:38:14.779740 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 323/565] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:14 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:14.860022 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:14.861458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:14.869732 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:14.870693 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:14.873940 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:14.874754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:15.044688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:15.052984 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-eae1bf58-8d0d-413b-a2d0-22ca464a3131 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.199398 Jan 25 03:38:15.053459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 243/566] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:14 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:15.380613 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-41de1fff-3720-4bf6-a12a-6c2a3369bb17 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:15.382219 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-41de1fff-3720-4bf6-a12a-6c2a3369bb17 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:15.399017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41de1fff-3720-4bf6-a12a-6c2a3369bb17 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:15.400148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41de1fff-3720-4bf6-a12a-6c2a3369bb17 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:15.401578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41de1fff-3720-4bf6-a12a-6c2a3369bb17 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:15.402242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41de1fff-3720-4bf6-a12a-6c2a3369bb17 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:15.519099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-41de1fff-3720-4bf6-a12a-6c2a3369bb17 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.142631 Jan 25 03:38:15.519797 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 324/567] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:15 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:15.797151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:15.798539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:15.804669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:15.805128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:15.805912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:15.806352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:15.939236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:15.946665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-51842421-c464-4f27-904b-61765e98c88c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.153264 Jan 25 03:38:15.947253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 244/568] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:15 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:16.072549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:16.073525 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:16.082763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:16.083262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:16.084209 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:16.084662 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:16.229757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:16.242747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e5124dbe-91e1-4945-953a-e4bdfbcb9f97 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.175736 Jan 25 03:38:16.243860 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 325/569] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:16 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:16.531716 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3347e1af-d4ef-493c-8136-8d26f549a979 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:16.532957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3347e1af-d4ef-493c-8136-8d26f549a979 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:16.539249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3347e1af-d4ef-493c-8136-8d26f549a979 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:16.539658 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3347e1af-d4ef-493c-8136-8d26f549a979 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:16.540716 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3347e1af-d4ef-493c-8136-8d26f549a979 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:16.541316 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3347e1af-d4ef-493c-8136-8d26f549a979 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:16.663348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3347e1af-d4ef-493c-8136-8d26f549a979 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.135885 Jan 25 03:38:16.667277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 245/570] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:16 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:16.964049 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:16.964702 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:16.972118 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:16.973710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:16.973710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:16.973908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:17.122369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:17.130815 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4e512ac5-8503-4964-a0a6-9b25b3a46e59 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.170357 Jan 25 03:38:17.131506 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 326/571] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:16 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:17.262075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:17.264138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:17.271133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:17.271652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:17.272430 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:17.272859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:17.442720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:17.452818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f647f695-00a8-47cd-b543-dacdad6e0a6a tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.194618 Jan 25 03:38:17.453810 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 246/572] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:17 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:17.675254 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3c974db-0eaa-4197-89f9-13cec62fa55d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:17.676163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3c974db-0eaa-4197-89f9-13cec62fa55d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:17.682459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3c974db-0eaa-4197-89f9-13cec62fa55d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:17.682908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3c974db-0eaa-4197-89f9-13cec62fa55d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:17.683704 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3c974db-0eaa-4197-89f9-13cec62fa55d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:17.684140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3c974db-0eaa-4197-89f9-13cec62fa55d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:17.801491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3c974db-0eaa-4197-89f9-13cec62fa55d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.129993 Jan 25 03:38:17.805797 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 327/573] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:17 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:18.148317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:18.148920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:18.155981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:18.156429 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:18.157195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:18.157661 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:18.294794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:18.302824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a7055681-0560-427c-864f-e7a1ba456a52 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.158087 Jan 25 03:38:18.303778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 247/574] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:18 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:18.471305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:18.472106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:18.479382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:18.479915 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:18.480842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:18.481926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:18.622960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:18.631245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ca9698bb-e75f-44d0-813e-eebdcacf0ae5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.164558 Jan 25 03:38:18.631830 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 328/575] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:18 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:18.813357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-68940154-c9c5-4ad3-aac8-86c53e49b968 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:18.814284 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-68940154-c9c5-4ad3-aac8-86c53e49b968 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:18.821148 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68940154-c9c5-4ad3-aac8-86c53e49b968 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:18.821532 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68940154-c9c5-4ad3-aac8-86c53e49b968 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:18.822308 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68940154-c9c5-4ad3-aac8-86c53e49b968 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:18.822909 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68940154-c9c5-4ad3-aac8-86c53e49b968 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:18.930912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-68940154-c9c5-4ad3-aac8-86c53e49b968 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.121297 Jan 25 03:38:18.931765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 248/576] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:18 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:19.322705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:19.324165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:19.334719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:19.335517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:19.337035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:19.338173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:19.529866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:19.548103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d49a5507-68b3-4fa7-a702-1156aa374446 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.230976 Jan 25 03:38:19.549262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 329/577] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:19 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:19.651345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:19.653688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:19.663085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:19.663744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:19.665273 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:19.665892 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:19.861337 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:19.869540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-86f31631-2a33-4eee-a388-624406852e3b tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.224305 Jan 25 03:38:19.870151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 249/578] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:19 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:19.947386 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2a02654e-e00e-44c2-b84a-b78dbb8abf41 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:19.948231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2a02654e-e00e-44c2-b84a-b78dbb8abf41 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:19.954950 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a02654e-e00e-44c2-b84a-b78dbb8abf41 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:19.955429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a02654e-e00e-44c2-b84a-b78dbb8abf41 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:19.956244 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a02654e-e00e-44c2-b84a-b78dbb8abf41 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:19.956676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a02654e-e00e-44c2-b84a-b78dbb8abf41 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:20.051047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2a02654e-e00e-44c2-b84a-b78dbb8abf41 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.109106 Jan 25 03:38:20.052137 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 330/579] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:19 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:20.566426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:20.567362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:20.574530 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:20.575904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:20.576886 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:20.577326 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:20.719630 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:20.729540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f9859f37-ca80-46cc-a794-1edb0bd0a33c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.166560 Jan 25 03:38:20.733111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 250/580] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:20 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:20.886496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:20.887512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:20.894984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:20.895567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:20.896429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:20.896949 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:21.062876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ce66930c-94cd-4148-ad65-da43c16ce0f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:21.063816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ce66930c-94cd-4148-ad65-da43c16ce0f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:21.069967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ce66930c-94cd-4148-ad65-da43c16ce0f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:21.070667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ce66930c-94cd-4148-ad65-da43c16ce0f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:21.071466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ce66930c-94cd-4148-ad65-da43c16ce0f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:21.071909 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ce66930c-94cd-4148-ad65-da43c16ce0f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:21.077449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:21.085165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6fa5d477-854c-489b-855c-4b93c38b7836 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.202987 Jan 25 03:38:21.085737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 331/581] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:20 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:21.192555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ce66930c-94cd-4148-ad65-da43c16ce0f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.134022 Jan 25 03:38:21.193218 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 251/582] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:21 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:21.747961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:21.748609 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:21.758495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:21.760176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:21.761253 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:21.761801 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:21.916698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:21.924810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-76ce17dc-055a-48c2-9faf-ed61709a63da tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.180649 Jan 25 03:38:21.926911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 332/583] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:21 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:22.103501 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:22.104368 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:22.115015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:22.115015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:22.115015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:22.115015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:22.205386 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-725c29fa-ac09-477d-99fc-e3611ff90fad tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:22.206308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-725c29fa-ac09-477d-99fc-e3611ff90fad tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:22.213086 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-725c29fa-ac09-477d-99fc-e3611ff90fad tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:22.213906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-725c29fa-ac09-477d-99fc-e3611ff90fad tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:22.214812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-725c29fa-ac09-477d-99fc-e3611ff90fad tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:22.215411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-725c29fa-ac09-477d-99fc-e3611ff90fad tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:22.268955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:22.277847 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2ad48111-db51-493e-b15c-eacd979f8f21 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.178449 Jan 25 03:38:22.281173 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 252/584] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:22 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:22.322464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-725c29fa-ac09-477d-99fc-e3611ff90fad tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.121365 Jan 25 03:38:22.323964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 333/585] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:22 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:22.941581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:22.942116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:22.949315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:22.949767 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:22.950931 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:22.951406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:23.101018 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:23.108775 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d8da80ee-2417-4303-b751-f71e260e6d95 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.170921 Jan 25 03:38:23.110012 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 253/586] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:22 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:23.294923 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:23.295684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:23.302603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:23.303163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:23.304007 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:23.304449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:23.334765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-202fbf20-3683-4677-ace5-f33cadd65fbe tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:23.336259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-202fbf20-3683-4677-ace5-f33cadd65fbe tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:23.343422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202fbf20-3683-4677-ace5-f33cadd65fbe tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:23.344193 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202fbf20-3683-4677-ace5-f33cadd65fbe tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:23.345196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202fbf20-3683-4677-ace5-f33cadd65fbe tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:23.354045 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202fbf20-3683-4677-ace5-f33cadd65fbe tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:23.479523 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:23.489273 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1f48ddb2-c2ec-4032-814b-98c44573869e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.198437 Jan 25 03:38:23.489472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-202fbf20-3683-4677-ace5-f33cadd65fbe tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.158070 Jan 25 03:38:23.493252 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 254/587] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:23 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:23.493971 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 334/588] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:23 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:24.129113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:24.129951 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:24.138153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:24.138687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:24.139617 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:24.140062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:24.274458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:24.282164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5efc2b83-132d-44e0-8f7b-6a62b83fd875 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.157662 Jan 25 03:38:24.282726 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 255/589] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:24 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:24.501714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4945702d-6a48-40db-8f02-1db32237d339 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:24.502665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4945702d-6a48-40db-8f02-1db32237d339 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:24.509881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4945702d-6a48-40db-8f02-1db32237d339 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:24.510715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4945702d-6a48-40db-8f02-1db32237d339 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:24.511610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4945702d-6a48-40db-8f02-1db32237d339 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:24.512049 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4945702d-6a48-40db-8f02-1db32237d339 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:24.514184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:24.515148 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:24.523366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:24.523802 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:24.524804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:24.525454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:24.639635 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4945702d-6a48-40db-8f02-1db32237d339 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.141418 Jan 25 03:38:24.640322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 335/590] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:24 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:24.711614 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:24.724229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fb955447-0cf3-4759-bc7a-fb5649a78199 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.213890 Jan 25 03:38:24.725624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 256/591] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:24 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:25.300960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:25.301669 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:25.309142 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:25.309600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:25.310390 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:25.310837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:25.463879 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:25.472587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-03a300bb-9e7e-4253-983e-15950aa87244 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.177081 Jan 25 03:38:25.473154 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 336/592] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:25 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:25.651279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c76c4499-f4f5-4650-8776-37814cd0346a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:25.652336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c76c4499-f4f5-4650-8776-37814cd0346a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:25.659467 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c76c4499-f4f5-4650-8776-37814cd0346a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:25.659964 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c76c4499-f4f5-4650-8776-37814cd0346a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:25.660771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c76c4499-f4f5-4650-8776-37814cd0346a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:25.661227 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c76c4499-f4f5-4650-8776-37814cd0346a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:25.743931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:25.744572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:25.752146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:25.752965 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:25.753759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:25.754683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:25.757684 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c76c4499-f4f5-4650-8776-37814cd0346a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.110018 Jan 25 03:38:25.758846 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 257/593] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:25 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:25.911209 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:25.919775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fc2b9d0f-d09a-4127-beac-174d979ba564 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.179403 Jan 25 03:38:25.920340 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 337/594] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:25 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:26.494396 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:26.495536 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:26.503246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:26.503770 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:26.504854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:26.505354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:26.694983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:26.705598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b5a904d1-596a-4b71-9a3f-0686e0e0c8fa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.215452 Jan 25 03:38:26.710431 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 258/595] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:26 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:26.770923 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-154b0e4d-f6a3-414e-a5e1-5db93760755a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:26.771867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-154b0e4d-f6a3-414e-a5e1-5db93760755a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:26.778401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-154b0e4d-f6a3-414e-a5e1-5db93760755a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:26.778857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-154b0e4d-f6a3-414e-a5e1-5db93760755a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:26.779790 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-154b0e4d-f6a3-414e-a5e1-5db93760755a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:26.781070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-154b0e4d-f6a3-414e-a5e1-5db93760755a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:26.892226 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-154b0e4d-f6a3-414e-a5e1-5db93760755a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28643 microversion: 2.20 time: 0.125888 Jan 25 03:38:26.893446 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 338/596] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:26 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28643 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:26.941582 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:26.942223 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:26.949103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:26.949504 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:26.950601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:26.951205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:27.097482 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:27.105432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f66e3a70-c164-4bec-aa80-f75f8f99b443 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.167539 Jan 25 03:38:27.106615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 259/597] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:26 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:27.724624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:27.727332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:27.747204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:27.750246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:27.750246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:27.750246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:27.905427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-70c5f49a-05a4-47a1-addd-e2468800947f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:27.909624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-70c5f49a-05a4-47a1-addd-e2468800947f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:27.926856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70c5f49a-05a4-47a1-addd-e2468800947f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:27.927480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70c5f49a-05a4-47a1-addd-e2468800947f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:27.928280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70c5f49a-05a4-47a1-addd-e2468800947f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:27.932624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70c5f49a-05a4-47a1-addd-e2468800947f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:27.961147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:27.969064 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9567db8b-560b-4242-9311-3461893ca2b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.250114 Jan 25 03:38:27.969693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 339/598] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:27 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:28.061206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-70c5f49a-05a4-47a1-addd-e2468800947f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 28976 microversion: 2.20 time: 0.158356 Jan 25 03:38:28.062765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 260/599] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:27 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 28976 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:28.138880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:28.141680 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:28.159939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:28.161842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:28.165341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:28.166149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:28.412829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:28.421565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-048b7dbc-6141-45f6-a8cd-77501831993f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.297181 Jan 25 03:38:28.422130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 340/600] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:28 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:28.986902 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:28.987736 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:28.995416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:28.995877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:28.997034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:28.997483 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:29.082485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-87c56a23-5997-4777-953a-1779232cf7f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:29.082929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-87c56a23-5997-4777-953a-1779232cf7f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:29.089340 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87c56a23-5997-4777-953a-1779232cf7f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:29.089817 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87c56a23-5997-4777-953a-1779232cf7f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:29.091366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87c56a23-5997-4777-953a-1779232cf7f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:29.091839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87c56a23-5997-4777-953a-1779232cf7f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:29.359616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:29.368738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c4958504-dd09-4c21-8e8b-a34d116dcc54 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.385769 Jan 25 03:38:29.375921 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-87c56a23-5997-4777-953a-1779232cf7f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 30605 microversion: 2.20 time: 0.297345 Jan 25 03:38:29.377806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 341/601] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:29 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 30605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:29.385265 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 261/602] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:28 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:29.456071 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:29.458237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:29.473188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:29.473950 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:29.474998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:29.475612 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:29.778986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:29.787893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9f12f0a7-535a-4913-8c92-687d64c92e7d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.352278 Jan 25 03:38:29.788942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 342/603] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:29 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:30.390189 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-dc3fff3b-8134-47dd-94bb-85858ffef859 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:30.391879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-dc3fff3b-8134-47dd-94bb-85858ffef859 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:30.393389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:30.394552 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:30.400687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc3fff3b-8134-47dd-94bb-85858ffef859 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:30.401091 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:30.401550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:30.401762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc3fff3b-8134-47dd-94bb-85858ffef859 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:30.403255 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc3fff3b-8134-47dd-94bb-85858ffef859 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:30.404102 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc3fff3b-8134-47dd-94bb-85858ffef859 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:30.405581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:30.406051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:30.564106 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-dc3fff3b-8134-47dd-94bb-85858ffef859 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 31687 microversion: 2.20 time: 0.179335 Jan 25 03:38:30.570984 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 262/604] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:30 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 31687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:30.667924 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:30.675484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e1c5f6d5-b176-425f-909f-a6ba3c04fa7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.287045 Jan 25 03:38:30.676195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 343/605] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:30 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:30.806605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:30.807378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:30.821141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:30.821973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:30.823811 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:30.824749 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:30.980564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:30.989904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-53e4aaa9-a96c-4905-8124-5d0053dd076f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.187630 Jan 25 03:38:31.000500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 263/606] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:30 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:31.582596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d38a683b-b6b4-4686-b074-5178902c71d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:31.584082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d38a683b-b6b4-4686-b074-5178902c71d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:31.591982 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d38a683b-b6b4-4686-b074-5178902c71d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:31.592729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d38a683b-b6b4-4686-b074-5178902c71d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:31.593723 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d38a683b-b6b4-4686-b074-5178902c71d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:31.594145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d38a683b-b6b4-4686-b074-5178902c71d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:31.692389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:31.693616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:31.701697 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:31.702399 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:31.703225 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:31.704064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:31.877718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:31.885609 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c8424b5e-1418-478f-add9-d1fec3c32ae9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.196779 Jan 25 03:38:31.886290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 264/607] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:31 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:32.007354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:32.008325 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:32.015394 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:32.015924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:32.016768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:32.017271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:32.170659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:32.179220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-12501f00-0f2a-41fa-bf73-0f4bb8b9cef4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.175360 Jan 25 03:38:32.179822 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 265/608] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:32 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:32.491409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d38a683b-b6b4-4686-b074-5178902c71d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 33206 microversion: 2.20 time: 0.912598 Jan 25 03:38:32.492422 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 344/609] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:31 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 33206 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:32.902074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:32.904900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:32.912467 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:32.913197 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:32.914375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:32.915003 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:33.079630 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:33.087672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-983ec205-991d-48d1-b2b9-af9fc412c6e1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.189461 Jan 25 03:38:33.088303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 266/610] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:32 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:33.197721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:33.199103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:33.206729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:33.207529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:33.208560 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:33.209199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:33.490111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:33.504226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8c0653a7-b542-4a54-b971-ac95dc677803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:33.505364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8c0653a7-b542-4a54-b971-ac95dc677803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:33.513260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3ddf039-ad7a-4e35-84ba-8458a5df15ec tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1573 microversion: 2.1 time: 0.319718 Jan 25 03:38:33.525043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c0653a7-b542-4a54-b971-ac95dc677803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:33.530101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c0653a7-b542-4a54-b971-ac95dc677803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:33.530101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c0653a7-b542-4a54-b971-ac95dc677803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:33.535746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c0653a7-b542-4a54-b971-ac95dc677803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:33.539558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 345/611] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:33 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1573 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:33.689100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8c0653a7-b542-4a54-b971-ac95dc677803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 33608 microversion: 2.20 time: 0.188321 Jan 25 03:38:33.689747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 267/612] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:33 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 33608 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:34.110191 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:34.110803 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:34.120395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.120857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.122030 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.122483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.338903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:34.347047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-86aaf8a8-80fc-4a9c-82a8-4a242c5b61a0 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.241405 Jan 25 03:38:34.348916 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 346/613] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:34 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:34.531252 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:34.534182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:34.553788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.554605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.555658 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.556816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.711470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9ea6960e-34f5-43b3-8a00-543394bb54cd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:34.713653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9ea6960e-34f5-43b3-8a00-543394bb54cd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:34.722948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea6960e-34f5-43b3-8a00-543394bb54cd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.724109 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea6960e-34f5-43b3-8a00-543394bb54cd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.724705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:34.725459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea6960e-34f5-43b3-8a00-543394bb54cd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.726436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea6960e-34f5-43b3-8a00-543394bb54cd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.733457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-adc34d29-c6fa-4881-b95e-ec5d65b56088 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1553 microversion: 2.1 time: 0.206989 Jan 25 03:38:34.735481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 268/614] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:34 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:34.750881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:34.751785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:34.758047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.758528 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.759353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.759793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.846278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] HTTP exception thrown: Cannot 'detach_volume' instance 17d82b81-05dd-4075-8d84-577551c2a689 while it is in vm_state rescued Jan 25 03:38:34.846868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Returning 409 to user: Cannot 'detach_volume' instance 17d82b81-05dd-4075-8d84-577551c2a689 while it is in vm_state rescued {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:38:34.847759 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-580a0872-7e8c-4a8f-9ec5-5c8526f4f5f7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "DELETE /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments/0a2b39bd-ecf3-4f17-9d1f-ce4114be8e1d" status: 409 len: 152 microversion: 2.1 time: 0.101708 Jan 25 03:38:34.848522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 269/615] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:38:34 2022] DELETE /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments/0a2b39bd-ecf3-4f17-9d1f-ce4114be8e1d => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 25 03:38:34.856430 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c9d29ebf-77f4-497a-8a38-a54a2fb14ea9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:34.856948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c9d29ebf-77f4-497a-8a38-a54a2fb14ea9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:34.863511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9d29ebf-77f4-497a-8a38-a54a2fb14ea9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.864152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9d29ebf-77f4-497a-8a38-a54a2fb14ea9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.864944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9d29ebf-77f4-497a-8a38-a54a2fb14ea9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:34.865363 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9d29ebf-77f4-497a-8a38-a54a2fb14ea9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:34.870554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9ea6960e-34f5-43b3-8a00-543394bb54cd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 34323 microversion: 2.20 time: 0.172148 Jan 25 03:38:34.877156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 347/616] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:34 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 34323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:35.132988 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c9d29ebf-77f4-497a-8a38-a54a2fb14ea9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action" status: 202 len: 0 microversion: 2.1 time: 0.279644 Jan 25 03:38:35.134127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 270/617] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:38:34 2022] POST /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:35.149756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:35.150454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:35.159301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:35.160098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:35.161119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:35.162181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:35.308424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:35.322995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-40503470-d1e7-4537-806a-aebcb90614ff tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1561 microversion: 2.1 time: 0.179083 Jan 25 03:38:35.325461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 348/618] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:35 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:35.369578 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:35.374077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:35.378487 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:35.379682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:35.380690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:35.381459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:35.674104 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:35.681602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-52d5b1ae-1214-496b-b5bd-4834d41ea254 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.316470 Jan 25 03:38:35.682180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 271/619] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:35 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:35.882961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-858b14cf-998e-44aa-adc1-e1f11d0387e5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:35.883908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-858b14cf-998e-44aa-adc1-e1f11d0387e5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:35.890932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-858b14cf-998e-44aa-adc1-e1f11d0387e5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:35.893292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-858b14cf-998e-44aa-adc1-e1f11d0387e5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:35.893292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-858b14cf-998e-44aa-adc1-e1f11d0387e5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:35.893292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-858b14cf-998e-44aa-adc1-e1f11d0387e5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:36.087659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-858b14cf-998e-44aa-adc1-e1f11d0387e5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 35200 microversion: 2.20 time: 0.208253 Jan 25 03:38:36.088298 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 349/620] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:35 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 35200 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:36.341554 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:36.342286 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:36.353478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:36.354041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:36.354906 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:36.355549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:36.494672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:36.503142 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-13e76dda-780b-46ab-9052-a84ccf0f89ce tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1561 microversion: 2.1 time: 0.165225 Jan 25 03:38:36.503792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 272/621] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:36 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:36.698898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:36.699647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:36.706481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:36.706931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:36.707733 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:36.708165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:36.847770 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:36.855263 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2fc97a23-b451-4039-9fdb-a879e33580e2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.160647 Jan 25 03:38:36.856510 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 350/622] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:36 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:37.099660 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-521535d1-b036-4d0b-9da6-a08f7eb9b76b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:37.100618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-521535d1-b036-4d0b-9da6-a08f7eb9b76b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:37.107490 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-521535d1-b036-4d0b-9da6-a08f7eb9b76b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:37.107942 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-521535d1-b036-4d0b-9da6-a08f7eb9b76b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:37.108719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-521535d1-b036-4d0b-9da6-a08f7eb9b76b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:37.109157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-521535d1-b036-4d0b-9da6-a08f7eb9b76b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:37.239294 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-521535d1-b036-4d0b-9da6-a08f7eb9b76b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 35895 microversion: 2.20 time: 0.143013 Jan 25 03:38:37.240215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 273/623] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:37 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 35895 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:37.365412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-02cfac7d-e232-43f9-9c3a-a606391fafc6 req-9e8dc3c4-c55a-4f99-8c48-5e7e4cb78b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe745e9c-07ae-4b28-a900-c80c2483da22", "name": "network-vif-plugged", "status": "completed", "tag": "4fb97a43-a6b7-44dd-bde5-dba0bb60c4f0"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:37.366963 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:38:37.366963 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:38:37.374732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-02cfac7d-e232-43f9-9c3a-a606391fafc6 req-9e8dc3c4-c55a-4f99-8c48-5e7e4cb78b14 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:37.375220 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-02cfac7d-e232-43f9-9c3a-a606391fafc6 req-9e8dc3c4-c55a-4f99-8c48-5e7e4cb78b14 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:37.388346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-02cfac7d-e232-43f9-9c3a-a606391fafc6 req-9e8dc3c4-c55a-4f99-8c48-5e7e4cb78b14 service nova] Creating event network-vif-plugged:4fb97a43-a6b7-44dd-bde5-dba0bb60c4f0 for instance fe745e9c-07ae-4b28-a900-c80c2483da22 on hv-cinder-81901 Jan 25 03:38:37.393353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-02cfac7d-e232-43f9-9c3a-a606391fafc6 req-9e8dc3c4-c55a-4f99-8c48-5e7e4cb78b14 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Jan 25 03:38:37.393942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 351/624] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:38:37.525512 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:37.526473 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:37.535674 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:37.536453 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:37.537596 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:37.538549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:37.680417 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:37.689969 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-35a251fe-138b-4663-9905-477975a15de7 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1561 microversion: 2.1 time: 0.172118 Jan 25 03:38:37.690539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 274/625] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:37 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:37.873978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:37.874768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:37.882362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:37.882362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:37.883096 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:37.883542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:38.020360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:38.028802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-83776b6f-42a5-4016-8865-3f64fb66fdb4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.159187 Jan 25 03:38:38.029492 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 352/626] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:37 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:38.251769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-beebe177-d7f0-4e51-95ee-db153a7b8ebf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:38.252724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-beebe177-d7f0-4e51-95ee-db153a7b8ebf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:38.259013 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-beebe177-d7f0-4e51-95ee-db153a7b8ebf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:38.259488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-beebe177-d7f0-4e51-95ee-db153a7b8ebf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:38.260262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-beebe177-d7f0-4e51-95ee-db153a7b8ebf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:38.260692 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-beebe177-d7f0-4e51-95ee-db153a7b8ebf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:38.670769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-beebe177-d7f0-4e51-95ee-db153a7b8ebf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 36985 microversion: 2.20 time: 0.422552 Jan 25 03:38:38.671479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 275/627] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:38 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 36985 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:38.707985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:38.708841 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:38.715676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:38.716142 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:38.716934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:38.717379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:38.876639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:38.884467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-95795833-0876-4d20-8f37-ad2bc6261904 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1561 microversion: 2.1 time: 0.180171 Jan 25 03:38:38.885050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 353/628] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:38 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:39.045763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:39.046403 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:39.054105 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:39.054999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:39.055639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:39.056076 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:39.196188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:39.204433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-64d977bf-e476-47bf-a5cc-b31ac43b61b5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.162969 Jan 25 03:38:39.205006 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 276/629] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:39 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:39.682305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ba6c3a0c-1489-4343-88ed-0e0dd3053254 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:39.683190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ba6c3a0c-1489-4343-88ed-0e0dd3053254 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:39.690258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba6c3a0c-1489-4343-88ed-0e0dd3053254 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:39.690716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba6c3a0c-1489-4343-88ed-0e0dd3053254 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:39.691546 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba6c3a0c-1489-4343-88ed-0e0dd3053254 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:39.692022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba6c3a0c-1489-4343-88ed-0e0dd3053254 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:39.908592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:39.908592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:39.911103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:39.911561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:39.912353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:39.912794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:39.941357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ba6c3a0c-1489-4343-88ed-0e0dd3053254 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 38182 microversion: 2.20 time: 0.262984 Jan 25 03:38:39.942614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 354/630] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:39 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 38182 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:40.055399 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:40.063406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cece8647-5d38-427d-b508-b96efe88fe4e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1561 microversion: 2.1 time: 0.164906 Jan 25 03:38:40.063997 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 277/631] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:39 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:40.227834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:40.228653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:40.236876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:40.237424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:40.238292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:40.238808 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:40.408917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:40.416258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2814fd42-f784-4ff0-85e5-efee211f1c90 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1322 microversion: 2.1 time: 0.194513 Jan 25 03:38:40.416822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 355/632] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:40 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:40.955434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bc02213b-fbec-47b4-b030-9ac54770b93b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:40.962230 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bc02213b-fbec-47b4-b030-9ac54770b93b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:40.976561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc02213b-fbec-47b4-b030-9ac54770b93b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:40.977017 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc02213b-fbec-47b4-b030-9ac54770b93b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:40.977826 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc02213b-fbec-47b4-b030-9ac54770b93b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:40.978267 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bc02213b-fbec-47b4-b030-9ac54770b93b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.081694 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:41.082315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:41.088560 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.089235 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.090873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.091429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.224285 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bc02213b-fbec-47b4-b030-9ac54770b93b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 38182 microversion: 2.20 time: 0.272807 Jan 25 03:38:41.225464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 278/633] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:40 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 38182 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:41.349561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:41.370564 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a55a8edc-aa01-412e-b744-6e9646b5f128 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1567 microversion: 2.1 time: 0.293233 Jan 25 03:38:41.371911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 356/634] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:41 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:41.434630 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:41.435250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:41.443731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:41.443731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:41.443960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.444716 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.449126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.450197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.451005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.451503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.456017 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.458395 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.562489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lazy-loading 'services' on Instance uuid 17d82b81-05dd-4075-8d84-577551c2a689 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:38:41.737912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:41.750763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-42a6fd9b-169b-45a6-94fe-01462e14c8d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1512 microversion: 2.1 time: 0.317047 Jan 25 03:38:41.751886 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 279/635] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:41 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:41.798048 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-536b2e03-baf6-4a0d-9052-7e54b2e464a4 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "DELETE /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments/0a2b39bd-ecf3-4f17-9d1f-ce4114be8e1d" status: 202 len: 0 microversion: 2.1 time: 0.361322 Jan 25 03:38:41.807402 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 357/636] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:38:41 2022] DELETE /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments/0a2b39bd-ecf3-4f17-9d1f-ce4114be8e1d => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:41.809765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-281fc59b-acf9-4385-9ba5-3743ef5d9d38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:41.811007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-281fc59b-acf9-4385-9ba5-3743ef5d9d38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:41.818419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-281fc59b-acf9-4385-9ba5-3743ef5d9d38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.819128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-281fc59b-acf9-4385-9ba5-3743ef5d9d38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.820817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-281fc59b-acf9-4385-9ba5-3743ef5d9d38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:41.821451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-281fc59b-acf9-4385-9ba5-3743ef5d9d38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:41.864509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-281fc59b-acf9-4385-9ba5-3743ef5d9d38 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061319 Jan 25 03:38:41.866699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 280/637] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:41 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:42.238293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-cbb1939e-dda0-46cc-9535-259a0ecc5786 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:42.239496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-cbb1939e-dda0-46cc-9535-259a0ecc5786 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:42.246513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbb1939e-dda0-46cc-9535-259a0ecc5786 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:42.246968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbb1939e-dda0-46cc-9535-259a0ecc5786 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:42.247977 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbb1939e-dda0-46cc-9535-259a0ecc5786 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:42.248590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbb1939e-dda0-46cc-9535-259a0ecc5786 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:42.368992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-cbb1939e-dda0-46cc-9535-259a0ecc5786 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 38182 microversion: 2.20 time: 0.134594 Jan 25 03:38:42.370135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 358/638] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:42 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 38182 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:42.882389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-103d982a-5b3f-4c14-81f7-3110ddb368ea tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:42.890640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-103d982a-5b3f-4c14-81f7-3110ddb368ea tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:42.899446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-103d982a-5b3f-4c14-81f7-3110ddb368ea tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:42.900045 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-103d982a-5b3f-4c14-81f7-3110ddb368ea tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:42.901056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-103d982a-5b3f-4c14-81f7-3110ddb368ea tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:42.901713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-103d982a-5b3f-4c14-81f7-3110ddb368ea tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:42.951509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-103d982a-5b3f-4c14-81f7-3110ddb368ea tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074556 Jan 25 03:38:42.952518 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 281/639] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:42 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:43.382379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-14f1b3c3-5115-4004-ab13-8a7ead95d894 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:43.384103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-14f1b3c3-5115-4004-ab13-8a7ead95d894 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:43.392851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f1b3c3-5115-4004-ab13-8a7ead95d894 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:43.393303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f1b3c3-5115-4004-ab13-8a7ead95d894 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:43.394086 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f1b3c3-5115-4004-ab13-8a7ead95d894 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:43.394516 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f1b3c3-5115-4004-ab13-8a7ead95d894 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:43.535001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-14f1b3c3-5115-4004-ab13-8a7ead95d894 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 200 len: 38323 microversion: 2.20 time: 0.156565 Jan 25 03:38:43.539763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 359/640] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:43 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 38323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:38:43.551280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cc3cc912-8af9-4136-af65-977562774246 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:43.551773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cc3cc912-8af9-4136-af65-977562774246 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:43.563499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc3cc912-8af9-4136-af65-977562774246 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:43.563499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc3cc912-8af9-4136-af65-977562774246 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:43.563499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc3cc912-8af9-4136-af65-977562774246 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:43.563499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cc3cc912-8af9-4136-af65-977562774246 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:43.619782 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cc3cc912-8af9-4136-af65-977562774246 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/ips" status: 200 len: 151 microversion: 2.20 time: 0.068953 Jan 25 03:38:43.622214 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 282/641] 10.222.0.115 () {60 vars in 1293 bytes} [Tue Jan 25 03:38:43 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/ips => generated 151 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:38:43.964019 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-22b76349-1735-445b-ab64-1c0839f4a324 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:43.965672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-22b76349-1735-445b-ab64-1c0839f4a324 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:43.974032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22b76349-1735-445b-ab64-1c0839f4a324 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:43.974762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22b76349-1735-445b-ab64-1c0839f4a324 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:43.976271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22b76349-1735-445b-ab64-1c0839f4a324 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:43.976712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22b76349-1735-445b-ab64-1c0839f4a324 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:44.012818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-22b76349-1735-445b-ab64-1c0839f4a324 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051240 Jan 25 03:38:44.012818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 360/642] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:43 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:44.696737 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2d5c4345-91e9-47e4-9ee9-528f6b8d9bde tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fec34b25-9130-4351-84e6-cc9d756eb3ee"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:44.698428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2d5c4345-91e9-47e4-9ee9-528f6b8d9bde tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:44.706030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d5c4345-91e9-47e4-9ee9-528f6b8d9bde tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:44.706748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d5c4345-91e9-47e4-9ee9-528f6b8d9bde tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:44.708087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d5c4345-91e9-47e4-9ee9-528f6b8d9bde tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:44.708694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d5c4345-91e9-47e4-9ee9-528f6b8d9bde tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:45.023529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c12b0ef2-4bc4-46d9-a25c-45ee5226cf6f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:45.025349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c12b0ef2-4bc4-46d9-a25c-45ee5226cf6f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:45.035586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c12b0ef2-4bc4-46d9-a25c-45ee5226cf6f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:45.035586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c12b0ef2-4bc4-46d9-a25c-45ee5226cf6f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:45.035586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c12b0ef2-4bc4-46d9-a25c-45ee5226cf6f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:45.035586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c12b0ef2-4bc4-46d9-a25c-45ee5226cf6f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:45.069991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c12b0ef2-4bc4-46d9-a25c-45ee5226cf6f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050201 Jan 25 03:38:45.071323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 361/643] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:45 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 25 03:38:45.501349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2d5c4345-91e9-47e4-9ee9-528f6b8d9bde tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "POST /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798858 Jan 25 03:38:45.501349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 283/644] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:38:44 2022] POST /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:48.240268 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:48.241424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:48.249138 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:48.249594 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:48.250569 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:48.251015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:48.278049 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lazy-loading 'flavor' on Instance uuid b5c1179f-67c0-4198-8933-7cabe5c964f3 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:38:48.863596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0a90c6e7-4c8e-46c0-9e7a-b1b58470d7c0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 202 len: 0 microversion: 2.20 time: 0.627400 Jan 25 03:38:48.864562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 362/645] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:38:48 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:38:48.873854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:48.875111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:48.886220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:48.886220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:48.886220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:48.886220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:49.085742 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:49.095547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:49.097614 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:49.098841 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7e573a95-617b-433a-804c-c6110ca2b50e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.229776 Jan 25 03:38:49.099704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 284/646] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:48 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:38:50.120441 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:50.122615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:50.131972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:50.133199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:50.133904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:50.134706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:50.218133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6c3e3d92-db65-4816-8de8-260d0ed074ff tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31d3f0f4-8919-4b7a-b643-63fd887e2c52", "device": "/dev/sdb"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:50.220873 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6c3e3d92-db65-4816-8de8-260d0ed074ff tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:50.228155 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c3e3d92-db65-4816-8de8-260d0ed074ff tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:50.228615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c3e3d92-db65-4816-8de8-260d0ed074ff tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:50.231485 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c3e3d92-db65-4816-8de8-260d0ed074ff tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:50.231485 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c3e3d92-db65-4816-8de8-260d0ed074ff tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:50.675631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:50.697472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:50.701711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:50.707853 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fe03cec8-5066-49d8-9d98-8ae9eb247ec9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.592230 Jan 25 03:38:50.712628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 363/647] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:50 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:38:51.254867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6c3e3d92-db65-4816-8de8-260d0ed074ff tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "POST /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.040250 Jan 25 03:38:51.256762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 285/648] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:38:50 2022] POST /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7/os-volume_attachments => generated 194 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:38:51.520554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:51.523096 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:51.533148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:51.533892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:51.534716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:51.535197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:51.569243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:38:51.731740 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:51.732469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:51.738921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:51.739664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:51.740769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:51.741381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:51.923827 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5301fb8d-b728-4e07-9d09-bfda483ab61d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "DELETE /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 204 len: 0 microversion: 2.1 time: 0.408616 Jan 25 03:38:51.924418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 364/649] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:38:51 2022] DELETE /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:38:51.932617 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:51.935900 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:51.957478 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:51.958154 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:51.959510 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:51.960317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:52.034291 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:52.046075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:52.049974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:52.055537 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5c40be7d-bc91-47c4-a2d6-28aede8bd716 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.325910 Jan 25 03:38:52.056172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 286/650] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:51 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:38:52.132632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:52.143561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-46e41f20-c731-4480-8e53-b49731bbe678 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1512 microversion: 2.1 time: 0.214737 Jan 25 03:38:52.152514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 365/651] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:51 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:53.074580 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:53.076358 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:53.083238 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:53.083920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:53.085850 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:53.090723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:53.162463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:53.164856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:53.172774 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:53.173660 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:53.175073 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:53.178091 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:53.343967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:53.354839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-10439d1a-d0e3-4cd7-8ccc-a672e9d9e420 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1512 microversion: 2.1 time: 0.197208 Jan 25 03:38:53.355113 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 366/652] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:53 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:53.442321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:53.451699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:53.453459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:53.455601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6b68a751-fafb-474d-b6e8-81439a8fbfd6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.384970 Jan 25 03:38:53.455900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 287/653] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:53 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:38:53.995581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Action: 'create', calling method: .version_select at 0x7f33a84d89d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1048410455"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:54.010568 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for project 0fe72d0d8d144438a671aac4e939c693. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:38:54.014839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for user 792e6b0c7c4946ed88fbc454b1779485 and project 0fe72d0d8d144438a671aac4e939c693. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:38:54.026885 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [e924fddb-5e71-4938-aad2-41d1a3e53b38] AMQP server on 10.222.0.115:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 25 03:38:54.373527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:54.374133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:54.380488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:54.380924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:54.381722 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:54.382146 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:54.513220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:54.520549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bafc0a7e-e0ec-4c08-937e-b7482866833e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1512 microversion: 2.1 time: 0.152737 Jan 25 03:38:54.521124 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 288/654] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:54 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:38:54.525319 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:54.525930 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:54.532137 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:54.532590 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:54.533373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:54.533814 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:54.683347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:54.692146 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:54.693720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:54.695498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-279fd115-a8ba-48b1-81db-3cd1bbd793ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.173414 Jan 25 03:38:54.696062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 289/655] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:54 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:38:55.034277 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [e924fddb-5e71-4938-aad2-41d1a3e53b38] Reconnected to AMQP server on 10.222.0.115:5672 via [amqp] client with port 59004. Jan 25 03:38:55.365061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for project 0fe72d0d8d144438a671aac4e939c693. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:38:55.370028 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for user 792e6b0c7c4946ed88fbc454b1779485 and project 0fe72d0d8d144438a671aac4e939c693. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:38:55.386433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d8b66cb9-1010-46a5-8760-dbd71c98722c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 1.574338 Jan 25 03:38:55.387926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 367/656] 10.222.0.115 () {60 vars in 1162 bytes} [Tue Jan 25 03:38:53 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:55.540346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:55.541620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:55.549373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:55.550063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:55.551031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:55.551671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:55.714339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:55.715303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:55.734681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:55.735391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:55.736474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:55.737163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:55.870900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:55.884475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0a2e8cd4-56e0-41b8-8861-9076092d7a83 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1512 microversion: 2.1 time: 0.347890 Jan 25 03:38:55.890886 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 290/657] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:55 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:55.969341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:55.991721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:55.994670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:55.996728 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d8e43f96-5e92-4c2e-8229-1216f99a6b15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.286458 Jan 25 03:38:55.998899 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 368/658] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:55 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:38:56.511820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-87b6fcfd-0d84-4208-adca-3052c156b541 req-b2049a11-e0ca-4c45-a9f7-6ce548843c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a", "name": "network-vif-deleted", "tag": "7a3865a4-17c6-440a-8dd3-3ff9c0e019f2"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:38:56.513545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:38:56.513545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:38:56.521621 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-87b6fcfd-0d84-4208-adca-3052c156b541 req-b2049a11-e0ca-4c45-a9f7-6ce548843c1e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:56.522784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-87b6fcfd-0d84-4208-adca-3052c156b541 req-b2049a11-e0ca-4c45-a9f7-6ce548843c1e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:56.538728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-87b6fcfd-0d84-4208-adca-3052c156b541 req-b2049a11-e0ca-4c45-a9f7-6ce548843c1e service nova] Creating event network-vif-deleted:7a3865a4-17c6-440a-8dd3-3ff9c0e019f2 for instance 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a on hv-cinder-81901 Jan 25 03:38:56.545549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-87b6fcfd-0d84-4208-adca-3052c156b541 req-b2049a11-e0ca-4c45-a9f7-6ce548843c1e service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037584 Jan 25 03:38:56.546489 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 291/659] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:56.907812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:56.908619 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:56.915252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:56.915984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:56.920640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:56.920640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:56.958628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:56.959115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:56.961171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lazy-loading 'fault' on Instance uuid 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:38:57.019654 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:57.023010 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:57.025703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:57.031255 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e2630ad7-68e4-4123-a052-62ad84e1d6f0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1316 microversion: 2.1 time: 0.125513 Jan 25 03:38:57.035772 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 369/660] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:56 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1316 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:57.047287 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:57.048852 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:57.049859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:57.050300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:57.213839 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:57.220090 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:57.221615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:57.222799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5b73f695-8463-4bda-b820-2f4ba84cb180 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.209582 Jan 25 03:38:57.236348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 292/661] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:57 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:38:58.048638 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:58.049259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:58.056984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.057617 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.059306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.059892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.098231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.098771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.099322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lazy-loading 'fault' on Instance uuid 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:38:58.112365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:58.112947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:58.120119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.120686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.122663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.123803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.142964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:58.154562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-db196c30-ba2f-490c-bb54-668c1ec6a1b9 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 200 len: 1316 microversion: 2.1 time: 0.109420 Jan 25 03:38:58.155337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 370/662] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:58 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 1316 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:38:58.227354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'services' on Instance uuid fe745e9c-07ae-4b28-a900-c80c2483da22 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:38:58.242572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:58.243302 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:58.250978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.251483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.252287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.252767 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.428296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:58.436847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:58.438364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:58.439631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-074a5342-9678-42ae-840b-e28d37436daf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.200680 Jan 25 03:38:58.439900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-af0acc0b-f345-4c05-a3d0-7000160ed005 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments/fec34b25-9130-4351-84e6-cc9d756eb3ee" status: 202 len: 0 microversion: 2.1 time: 0.331710 Jan 25 03:38:58.440438 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 371/663] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:58 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:38:58.441639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 293/664] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:38:58 2022] DELETE /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments/fec34b25-9130-4351-84e6-cc9d756eb3ee => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:38:58.452913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-999e324c-4d34-4b7d-9408-e717dca4d189 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:58.453894 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-999e324c-4d34-4b7d-9408-e717dca4d189 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:58.460466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999e324c-4d34-4b7d-9408-e717dca4d189 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.461034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999e324c-4d34-4b7d-9408-e717dca4d189 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.462542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999e324c-4d34-4b7d-9408-e717dca4d189 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:58.462542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999e324c-4d34-4b7d-9408-e717dca4d189 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:58.498765 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-999e324c-4d34-4b7d-9408-e717dca4d189 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050337 Jan 25 03:38:58.499802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 372/665] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:58 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:59.173016 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:59.173715 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:59.179841 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.180290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.181063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.181497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.195219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] HTTP exception thrown: Instance 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a could not be found. Jan 25 03:38:59.195828 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Returning 404 to user: Instance 8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:38:59.196667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9cd13738-185b-4290-b79e-d708a21ea3af tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a" status: 404 len: 111 microversion: 2.1 time: 0.028209 Jan 25 03:38:59.197238 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 294/666] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:59 2022] GET /compute/v2.1/servers/8c4b9fd2-9afa-41ab-9101-0b27c5f9e42a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:38:59.206245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:59.206746 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:59.213163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.213597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.214422 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.215514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.240115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:38:59.458296 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:59.458930 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:59.464754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.465205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.465979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.466414 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.523959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-dd9413f5-30ca-429d-833a-68d8262ea967 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "DELETE /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 204 len: 0 microversion: 2.1 time: 0.321161 Jan 25 03:38:59.524580 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 373/667] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:38:59 2022] DELETE /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 25 03:38:59.530164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d4503c16-8e0b-429e-a1f7-15038587ab87 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:59.531265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d4503c16-8e0b-429e-a1f7-15038587ab87 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:59.537152 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4503c16-8e0b-429e-a1f7-15038587ab87 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.537608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4503c16-8e0b-429e-a1f7-15038587ab87 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.538397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4503c16-8e0b-429e-a1f7-15038587ab87 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.538903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d4503c16-8e0b-429e-a1f7-15038587ab87 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.569663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d4503c16-8e0b-429e-a1f7-15038587ab87 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Jan 25 03:38:59.570230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 374/668] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:38:59 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:38:59.575004 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:38:59.575637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:38:59.581033 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.581480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.582246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:38:59.582678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:38:59.601280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:59.609313 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:59.610856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:59.612111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-93bd7e8f-2f00-4751-b65f-66308069f66d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.157544 Jan 25 03:38:59.612748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 295/669] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:38:59 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:38:59.710800 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:38:59.718096 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-cbd35c26-8911-4612-b67e-1fbb492d28b5 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.146938 Jan 25 03:38:59.718669 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 375/670] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:38:59 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:00.581009 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-522b02ea-debe-4767-b080-ec70af6eb38b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:00.581946 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-522b02ea-debe-4767-b080-ec70af6eb38b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:00.588200 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-522b02ea-debe-4767-b080-ec70af6eb38b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:00.588654 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-522b02ea-debe-4767-b080-ec70af6eb38b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:00.589421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-522b02ea-debe-4767-b080-ec70af6eb38b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:00.590833 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-522b02ea-debe-4767-b080-ec70af6eb38b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:00.618930 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-522b02ea-debe-4767-b080-ec70af6eb38b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041615 Jan 25 03:39:00.619440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 296/671] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:00 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:00.630463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:00.631094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:00.637794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:00.638263 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:00.639044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:00.641996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:00.734882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:00.735530 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:00.741357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:00.741809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:00.742593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:00.745163 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:00.766566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:00.774371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:00.775895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:00.777705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-38aee5b6-eae7-4eb8-b552-c0eece58a348 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.150155 Jan 25 03:39:00.778341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 376/672] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:00 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:00.872973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:00.882671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-134febfa-c8ca-4066-9cd4-2a90ffbb972e tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.151595 Jan 25 03:39:00.887423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 297/673] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:00 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:01.630174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-39daa9d1-e50f-42c8-87fc-4776362bab7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:01.631092 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-39daa9d1-e50f-42c8-87fc-4776362bab7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:01.638027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-39daa9d1-e50f-42c8-87fc-4776362bab7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:01.638483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-39daa9d1-e50f-42c8-87fc-4776362bab7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:01.639293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-39daa9d1-e50f-42c8-87fc-4776362bab7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:01.639738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-39daa9d1-e50f-42c8-87fc-4776362bab7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:01.670189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-39daa9d1-e50f-42c8-87fc-4776362bab7f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Jan 25 03:39:01.670737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 377/674] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:01 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:01.795764 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:01.796288 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:01.802687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:01.803183 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:01.803959 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:01.804401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:01.900620 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:01.901226 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:01.906996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:01.907589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:01.908421 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:01.908855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:01.935459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:01.943400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:01.945170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:01.946319 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-89b95002-22a8-4785-bbdc-c8362a17f16a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.154480 Jan 25 03:39:01.946874 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 298/675] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:01 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:02.041909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:02.049416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-52b422fa-109d-4cd0-ab62-8aecdc32349d tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.152532 Jan 25 03:39:02.049927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 378/676] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:01 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:02.682030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7ff7d588-53e9-4573-a60c-83acb7577ab5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:02.682992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7ff7d588-53e9-4573-a60c-83acb7577ab5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:02.690500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ff7d588-53e9-4573-a60c-83acb7577ab5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:02.691207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ff7d588-53e9-4573-a60c-83acb7577ab5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:02.692153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ff7d588-53e9-4573-a60c-83acb7577ab5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:02.692767 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7ff7d588-53e9-4573-a60c-83acb7577ab5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:02.724711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7ff7d588-53e9-4573-a60c-83acb7577ab5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046268 Jan 25 03:39:02.725275 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 299/677] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:02 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:02.965957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:02.967354 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:02.973785 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:02.974235 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:02.975016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:02.975496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:03.066509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:03.067155 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:03.073708 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:03.074140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:03.074921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:03.075382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:03.146319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:03.154605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:03.156191 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:03.157368 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-17273520-a233-4793-ae11-25c558b90868 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.196125 Jan 25 03:39:03.157967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 379/678] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:02 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:03.209619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:03.217855 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a7a0966d-8c3d-48f7-8466-22b5bc89070f tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.154866 Jan 25 03:39:03.218355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 300/679] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:03 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:03.736291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3730b530-9d0c-4667-b87a-a654b7ae4cfc tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:03.737273 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3730b530-9d0c-4667-b87a-a654b7ae4cfc tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:03.743135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3730b530-9d0c-4667-b87a-a654b7ae4cfc tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:03.744822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3730b530-9d0c-4667-b87a-a654b7ae4cfc tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:03.744822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3730b530-9d0c-4667-b87a-a654b7ae4cfc tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:03.744822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3730b530-9d0c-4667-b87a-a654b7ae4cfc tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:03.774679 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3730b530-9d0c-4667-b87a-a654b7ae4cfc tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042249 Jan 25 03:39:03.775269 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 380/680] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:03 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:04.175941 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:04.176607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:04.182864 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:04.183339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:04.184124 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:04.185264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:04.234658 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:04.235407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:04.241881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:04.242571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:04.243400 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:04.243874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:04.360380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:04.384555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:04.386309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:04.388353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bda0520b-ed12-42fe-b75e-d731894fc3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.216218 Jan 25 03:39:04.389745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 301/681] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:04 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:04.434524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:04.442727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-527d5b0a-4358-4aa4-bd21-9247538b5305 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.212344 Jan 25 03:39:04.443335 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 381/682] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:04 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:04.786709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ec6eaea1-88ba-4bf5-83d8-dde9414b87a3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:04.787655 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ec6eaea1-88ba-4bf5-83d8-dde9414b87a3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:04.794219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec6eaea1-88ba-4bf5-83d8-dde9414b87a3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:04.794984 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec6eaea1-88ba-4bf5-83d8-dde9414b87a3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:04.795851 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec6eaea1-88ba-4bf5-83d8-dde9414b87a3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:04.796288 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec6eaea1-88ba-4bf5-83d8-dde9414b87a3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:04.825262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ec6eaea1-88ba-4bf5-83d8-dde9414b87a3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042116 Jan 25 03:39:04.829337 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 302/683] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:04 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:05.406946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:05.407596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:05.413919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:05.414221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:05.414968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:05.415474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:05.460491 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:05.461095 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:05.468168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:05.468622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:05.469406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:05.469846 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:05.558934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:05.568994 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:05.573036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:05.574478 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-75cf19fd-9d13-40ed-80b1-9e2b09481325 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.172319 Jan 25 03:39:05.576685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 382/684] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:05 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:39:05.617601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:05.625851 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d8dc890c-8bfd-4d85-8d27-b92d4838f467 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.169006 Jan 25 03:39:05.626422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 303/685] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:05 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:05.835989 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-85f9c3db-d7e7-4cf1-bbdd-50a23a79d536 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:05.836826 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-85f9c3db-d7e7-4cf1-bbdd-50a23a79d536 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:05.842821 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85f9c3db-d7e7-4cf1-bbdd-50a23a79d536 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:05.843313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85f9c3db-d7e7-4cf1-bbdd-50a23a79d536 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:05.844201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85f9c3db-d7e7-4cf1-bbdd-50a23a79d536 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:05.844645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85f9c3db-d7e7-4cf1-bbdd-50a23a79d536 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:05.877393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-85f9c3db-d7e7-4cf1-bbdd-50a23a79d536 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Jan 25 03:39:05.877960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 383/686] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:05 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:06.594606 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:06.595333 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:06.601527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:06.601960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:06.602724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:06.603178 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:06.648822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:06.649500 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:06.665310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:06.666098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:06.667245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:06.667633 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:06.767670 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:06.776598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:06.779752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:06.780384 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5d8496de-827d-4871-8087-c11b3ae67650 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.190143 Jan 25 03:39:06.781029 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 304/687] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:06 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:06.807466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:06.815717 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0e87a0a0-7d8d-47b2-a029-c2cae0386dba tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.175204 Jan 25 03:39:06.816298 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 384/688] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:06 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:06.889166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-50b47b0d-8f64-4e5a-9f1f-8521360ad7d1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:06.890078 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-50b47b0d-8f64-4e5a-9f1f-8521360ad7d1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:06.896007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50b47b0d-8f64-4e5a-9f1f-8521360ad7d1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:06.896450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50b47b0d-8f64-4e5a-9f1f-8521360ad7d1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:06.897213 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50b47b0d-8f64-4e5a-9f1f-8521360ad7d1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:06.897643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50b47b0d-8f64-4e5a-9f1f-8521360ad7d1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:06.929300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-50b47b0d-8f64-4e5a-9f1f-8521360ad7d1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Jan 25 03:39:06.931073 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 305/689] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:06 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:07.798822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:07.799656 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:07.806504 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:07.807070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:07.808044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:07.808591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:07.832091 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:07.832693 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:07.838753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:07.839209 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:07.840028 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:07.840999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:07.957719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:07.966578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:07.968395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:07.969595 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-627ca2e6-813e-473f-81cb-fa2e24bd24d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.175769 Jan 25 03:39:07.970197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 385/690] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:07 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:07.975231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-925b4047-bb36-4d62-9926-f3abe4b9d3b7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:07.976215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-925b4047-bb36-4d62-9926-f3abe4b9d3b7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:07.982906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-925b4047-bb36-4d62-9926-f3abe4b9d3b7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:07.983984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-925b4047-bb36-4d62-9926-f3abe4b9d3b7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:07.984991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-925b4047-bb36-4d62-9926-f3abe4b9d3b7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:07.985460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-925b4047-bb36-4d62-9926-f3abe4b9d3b7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:07.988134 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:08.004784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b9bb6a37-c7aa-4061-9c2a-580b999f9b25 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.176088 Jan 25 03:39:08.005369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 306/691] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:07 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:08.017249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-925b4047-bb36-4d62-9926-f3abe4b9d3b7 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045852 Jan 25 03:39:08.017801 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 386/692] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:07 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:08.987728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:08.988411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:08.994637 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:08.995114 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:08.995946 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:08.996381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:09.023182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:09.023797 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:09.030840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:09.031414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:09.032433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:09.032962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:09.136878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:09.145993 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:09.147639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:09.148869 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cf0aee5a-1f96-4cd0-a9d4-dbd8256a314a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.164978 Jan 25 03:39:09.149432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 307/693] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:08 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:09.157137 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3845e5ea-4d49-40a7-b79b-559aca8c4316 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:09.158054 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3845e5ea-4d49-40a7-b79b-559aca8c4316 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:09.163853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3845e5ea-4d49-40a7-b79b-559aca8c4316 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:09.164303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3845e5ea-4d49-40a7-b79b-559aca8c4316 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:09.165109 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3845e5ea-4d49-40a7-b79b-559aca8c4316 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:09.165546 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3845e5ea-4d49-40a7-b79b-559aca8c4316 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:09.168172 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:09.175750 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-86fc1aec-3014-4e6d-b347-2eb067d593d0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1527 microversion: 2.1 time: 0.156357 Jan 25 03:39:09.176484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 387/694] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:09 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1527 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:09.198054 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3845e5ea-4d49-40a7-b79b-559aca8c4316 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Jan 25 03:39:09.198624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 308/695] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:09 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:10.167618 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:10.168439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:10.175369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:10.176180 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:10.177212 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:10.177725 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:10.195042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:10.195830 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:10.202208 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:10.203914 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:10.204920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:10.205534 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:10.299840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:10.310172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-400487e3-2b10-47c2-b4b3-f431fc909734 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1485 microversion: 2.1 time: 0.118283 Jan 25 03:39:10.311405 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 309/696] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:10 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1485 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:10.317444 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-12ef9c98-c639-4289-93b8-95dcee33a71c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:10.318659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-12ef9c98-c639-4289-93b8-95dcee33a71c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:10.325785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12ef9c98-c639-4289-93b8-95dcee33a71c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:10.326521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12ef9c98-c639-4289-93b8-95dcee33a71c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:10.328146 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12ef9c98-c639-4289-93b8-95dcee33a71c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:10.328809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12ef9c98-c639-4289-93b8-95dcee33a71c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:10.363685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:10.374341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:10.376421 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:10.377587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-37b54443-c395-4b53-8d0c-07c9a3e2c09a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.213719 Jan 25 03:39:10.377975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-12ef9c98-c639-4289-93b8-95dcee33a71c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065065 Jan 25 03:39:10.378307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 388/697] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:10 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:10.378565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 310/698] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:10 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:10.383124 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-06c16539-b691-4a95-b7fb-56f37e179ce5 req-37655ecc-1564-4fd9-ae82-5465c66a04d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d82b81-05dd-4075-8d84-577551c2a689", "name": "network-vif-deleted", "tag": "29297f0b-07c1-43dd-9bc9-7ce2fc61fabf"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:39:10.387408 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:39:10.387408 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:39:10.392799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-06c16539-b691-4a95-b7fb-56f37e179ce5 req-37655ecc-1564-4fd9-ae82-5465c66a04d7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:10.393242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-06c16539-b691-4a95-b7fb-56f37e179ce5 req-37655ecc-1564-4fd9-ae82-5465c66a04d7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:10.403867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-06c16539-b691-4a95-b7fb-56f37e179ce5 req-37655ecc-1564-4fd9-ae82-5465c66a04d7 service nova] Creating event network-vif-deleted:29297f0b-07c1-43dd-9bc9-7ce2fc61fabf for instance 17d82b81-05dd-4075-8d84-577551c2a689 on hv-cinder-81901 Jan 25 03:39:10.410106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-06c16539-b691-4a95-b7fb-56f37e179ce5 req-37655ecc-1564-4fd9-ae82-5465c66a04d7 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030161 Jan 25 03:39:10.410744 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 389/699] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:11.328021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:11.328735 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:11.335741 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:11.336594 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:11.337427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:11.337870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:11.380303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:11.381018 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:11.381470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lazy-loading 'fault' on Instance uuid 17d82b81-05dd-4075-8d84-577551c2a689 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:39:11.408015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:11.408851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:11.415638 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:11.416146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:11.417003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:11.417497 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:11.426818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e068edc490c245eba236e3e13f40982f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7c304fa11cb41daba65e6a85cf2c360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:11.434426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-dc882b43-625d-44a5-b724-a873e5044f90 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 200 len: 1316 microversion: 2.1 time: 0.111118 Jan 25 03:39:11.435105 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 311/700] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:11 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:11.439629 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0f26a7fe-9d61-4420-a21e-0e44e2435ace tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:11.440598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0f26a7fe-9d61-4420-a21e-0e44e2435ace tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:11.448662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f26a7fe-9d61-4420-a21e-0e44e2435ace tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:11.449408 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f26a7fe-9d61-4420-a21e-0e44e2435ace tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:11.450385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f26a7fe-9d61-4420-a21e-0e44e2435ace tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:11.450884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f26a7fe-9d61-4420-a21e-0e44e2435ace tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:11.488469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0f26a7fe-9d61-4420-a21e-0e44e2435ace tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Jan 25 03:39:11.488469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 312/701] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:11 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:11.574689 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:11.584340 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:11.586297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:11.587494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-97a0c9ec-c5cc-4627-8820-dcc563101288 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.196019 Jan 25 03:39:11.588060 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 390/702] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:11 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:39:12.354241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-a6810a82-2006-4210-808d-0903d124ef96 req-6644f9cd-b5a0-48fd-bcdc-64398573e5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c1179f-67c0-4198-8933-7cabe5c964f3", "name": "network-vif-plugged", "status": "completed", "tag": "23790178-4f79-4bcf-a17f-bd8e5abf0427"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:39:12.356402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:39:12.356402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:39:12.364335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-a6810a82-2006-4210-808d-0903d124ef96 req-6644f9cd-b5a0-48fd-bcdc-64398573e5a3 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:12.364658 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-a6810a82-2006-4210-808d-0903d124ef96 req-6644f9cd-b5a0-48fd-bcdc-64398573e5a3 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:12.377103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-a6810a82-2006-4210-808d-0903d124ef96 req-6644f9cd-b5a0-48fd-bcdc-64398573e5a3 service nova] Creating event network-vif-plugged:23790178-4f79-4bcf-a17f-bd8e5abf0427 for instance b5c1179f-67c0-4198-8933-7cabe5c964f3 on hv-cinder-81901 Jan 25 03:39:12.382837 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-a6810a82-2006-4210-808d-0903d124ef96 req-6644f9cd-b5a0-48fd-bcdc-64398573e5a3 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033210 Jan 25 03:39:12.387732 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 313/703] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:12.451520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:12.452232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] [instance: 17d82b81-05dd-4075-8d84-577551c2a689] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:12.460611 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:12.461153 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:12.462041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:12.462535 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:12.477005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] HTTP exception thrown: Instance 17d82b81-05dd-4075-8d84-577551c2a689 could not be found. Jan 25 03:39:12.477681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] Returning 404 to user: Instance 17d82b81-05dd-4075-8d84-577551c2a689 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:39:12.478575 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5a316962-5632-44d4-a34c-0a4a6d9718b0 tempest-ServerRescueNegativeTestJSON-845188888 tempest-ServerRescueNegativeTestJSON-845188888-project] 10.222.0.115 "GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689" status: 404 len: 111 microversion: 2.1 time: 0.030842 Jan 25 03:39:12.479147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 391/704] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:12 2022] GET /compute/v2.1/servers/17d82b81-05dd-4075-8d84-577551c2a689 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:39:12.496625 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-574da6d9-0d37-401d-b4d5-50318442d350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:12.498696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-574da6d9-0d37-401d-b4d5-50318442d350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:12.505554 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-574da6d9-0d37-401d-b4d5-50318442d350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:12.506100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-574da6d9-0d37-401d-b4d5-50318442d350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:12.506972 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-574da6d9-0d37-401d-b4d5-50318442d350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:12.507503 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-574da6d9-0d37-401d-b4d5-50318442d350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:12.538100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-574da6d9-0d37-401d-b4d5-50318442d350 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047777 Jan 25 03:39:12.541936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 314/705] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:12 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:12.605479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:12.606350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:12.612770 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:12.613221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:12.613988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:12.614423 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:12.751343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:12.759372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:12.761146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:12.762461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ad5b86fa-6bbc-4f73-93a2-970d56b9f877 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.160505 Jan 25 03:39:12.763115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 392/706] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:12 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:13.551264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f6ef0ce5-99b6-427e-99a5-98f2a4f83c0d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:13.552112 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f6ef0ce5-99b6-427e-99a5-98f2a4f83c0d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:13.558667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f6ef0ce5-99b6-427e-99a5-98f2a4f83c0d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:13.559153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f6ef0ce5-99b6-427e-99a5-98f2a4f83c0d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:13.559941 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f6ef0ce5-99b6-427e-99a5-98f2a4f83c0d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:13.560381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f6ef0ce5-99b6-427e-99a5-98f2a4f83c0d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:13.606050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f6ef0ce5-99b6-427e-99a5-98f2a4f83c0d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059702 Jan 25 03:39:13.607262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 315/707] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:13 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:13.781404 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:13.781989 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:13.788296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:13.788747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:13.789519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:13.789955 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:13.939514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:13.948353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:13.949857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:13.951029 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3a3f07f-fcd4-4fd6-b082-0df16e24361c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.173851 Jan 25 03:39:13.951640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 393/708] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:13 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:14.618292 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2c3347fe-3d70-4aeb-a5b5-3618c84cd533 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:14.619221 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2c3347fe-3d70-4aeb-a5b5-3618c84cd533 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:14.625660 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2c3347fe-3d70-4aeb-a5b5-3618c84cd533 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:14.626114 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2c3347fe-3d70-4aeb-a5b5-3618c84cd533 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:14.626901 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2c3347fe-3d70-4aeb-a5b5-3618c84cd533 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:14.627365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2c3347fe-3d70-4aeb-a5b5-3618c84cd533 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:14.658445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2c3347fe-3d70-4aeb-a5b5-3618c84cd533 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Jan 25 03:39:14.662409 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 316/709] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:14 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:14.970205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:14.971034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:14.977541 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:14.978007 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:14.980519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:14.980519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:15.141303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:15.149126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:15.150870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:15.152068 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-368b493f-17cf-4f6e-92fd-53f161d82326 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.186214 Jan 25 03:39:15.153600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 394/710] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:14 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:15.669684 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9285fe44-4f50-4850-a8a9-32e5f5e4d33f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:15.670513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9285fe44-4f50-4850-a8a9-32e5f5e4d33f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:15.676726 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9285fe44-4f50-4850-a8a9-32e5f5e4d33f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:15.677168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9285fe44-4f50-4850-a8a9-32e5f5e4d33f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:15.677925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9285fe44-4f50-4850-a8a9-32e5f5e4d33f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:15.678352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9285fe44-4f50-4850-a8a9-32e5f5e4d33f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:15.708851 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9285fe44-4f50-4850-a8a9-32e5f5e4d33f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Jan 25 03:39:15.708851 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 317/711] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:15 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:16.170837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:16.172299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:16.178729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:16.179404 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:16.180000 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:16.180439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:16.313249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:16.321688 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:16.323261 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:16.329295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-19c57273-0463-4911-bee3-df97df6d77d3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.157321 Jan 25 03:39:16.329295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 395/712] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:16 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:16.719349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-25b6d9bc-c42e-408e-b796-06cb6e4d5cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:16.720260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-25b6d9bc-c42e-408e-b796-06cb6e4d5cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:16.726631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25b6d9bc-c42e-408e-b796-06cb6e4d5cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:16.727240 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25b6d9bc-c42e-408e-b796-06cb6e4d5cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:16.728094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25b6d9bc-c42e-408e-b796-06cb6e4d5cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:16.728533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25b6d9bc-c42e-408e-b796-06cb6e4d5cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:16.759560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-25b6d9bc-c42e-408e-b796-06cb6e4d5cc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Jan 25 03:39:16.760238 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 318/713] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:16 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:17.346050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:17.346886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:17.353187 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:17.353646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:17.354491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:17.354872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:17.497394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:17.506920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:17.513392 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:17.513392 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6afff630-eb55-491f-8a8d-550857f861e9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1748 microversion: 2.20 time: 0.168497 Jan 25 03:39:17.513392 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 396/714] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:17 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:17.772586 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-39285fa4-3e4a-4597-bf3c-f5eab34fc705 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:17.775522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-39285fa4-3e4a-4597-bf3c-f5eab34fc705 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:17.784695 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39285fa4-3e4a-4597-bf3c-f5eab34fc705 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:17.785314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39285fa4-3e4a-4597-bf3c-f5eab34fc705 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:17.786309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39285fa4-3e4a-4597-bf3c-f5eab34fc705 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:17.786840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39285fa4-3e4a-4597-bf3c-f5eab34fc705 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:17.822474 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-39285fa4-3e4a-4597-bf3c-f5eab34fc705 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054692 Jan 25 03:39:17.823050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 319/715] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:17 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:18.528267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:18.528888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:18.535937 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:18.536401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:18.537190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:18.537636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:18.672895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:18.680643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:18.682133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:18.683334 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-82f63b11-c627-4269-80d4-189f258685a2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.158731 Jan 25 03:39:18.684231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 397/716] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:18 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:18.834564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ad288c1d-66c1-4eaf-a61f-75ac591c6623 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:18.835509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ad288c1d-66c1-4eaf-a61f-75ac591c6623 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:18.842445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad288c1d-66c1-4eaf-a61f-75ac591c6623 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:18.842905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad288c1d-66c1-4eaf-a61f-75ac591c6623 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:18.843787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad288c1d-66c1-4eaf-a61f-75ac591c6623 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:18.844139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad288c1d-66c1-4eaf-a61f-75ac591c6623 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:18.878669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ad288c1d-66c1-4eaf-a61f-75ac591c6623 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048763 Jan 25 03:39:18.879275 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 320/717] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:18 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:19.702950 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:19.703588 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:19.710696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:19.711198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:19.711991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:19.712465 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:19.854723 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:19.862440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:19.863977 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:19.865147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-de05763f-2d1a-41c2-9a89-bcaaa1032a87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.165967 Jan 25 03:39:19.865874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 398/718] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:19 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:19.890891 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-80dbb6c2-9870-4acd-b028-530d861ba77d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:19.892059 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-80dbb6c2-9870-4acd-b028-530d861ba77d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:19.900427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-80dbb6c2-9870-4acd-b028-530d861ba77d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:19.901000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-80dbb6c2-9870-4acd-b028-530d861ba77d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:19.901848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-80dbb6c2-9870-4acd-b028-530d861ba77d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:19.902618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-80dbb6c2-9870-4acd-b028-530d861ba77d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:19.935176 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-80dbb6c2-9870-4acd-b028-530d861ba77d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048903 Jan 25 03:39:19.935750 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 321/719] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:19 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:20.882903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:20.883696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:20.890046 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:20.890504 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:20.891381 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:20.891826 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:20.946316 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-22f15624-58d5-4651-aaea-22ad4a81d426 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:20.947411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-22f15624-58d5-4651-aaea-22ad4a81d426 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:20.955775 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22f15624-58d5-4651-aaea-22ad4a81d426 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:20.956295 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22f15624-58d5-4651-aaea-22ad4a81d426 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:20.957266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22f15624-58d5-4651-aaea-22ad4a81d426 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:20.957699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22f15624-58d5-4651-aaea-22ad4a81d426 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:20.999787 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-22f15624-58d5-4651-aaea-22ad4a81d426 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057353 Jan 25 03:39:21.004881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 322/720] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:20 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:39:21.035514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:21.043264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:21.044745 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:21.045885 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e09f46c9-6a2b-451c-8d7b-f77a98f7d29c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.166631 Jan 25 03:39:21.046434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 399/721] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:20 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:22.011268 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-493c2102-7a32-414a-b250-6ed1495f3438 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:22.012199 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-493c2102-7a32-414a-b250-6ed1495f3438 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:22.018245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-493c2102-7a32-414a-b250-6ed1495f3438 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:22.018701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-493c2102-7a32-414a-b250-6ed1495f3438 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:22.019543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-493c2102-7a32-414a-b250-6ed1495f3438 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:22.019982 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-493c2102-7a32-414a-b250-6ed1495f3438 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:22.050388 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-493c2102-7a32-414a-b250-6ed1495f3438 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042829 Jan 25 03:39:22.051271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 323/722] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:22 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:22.063444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:22.064155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:22.070761 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:22.071242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:22.072034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:22.072478 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:22.200078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:22.208473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:22.209921 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:22.211112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-65de6ff4-ddce-447a-8aa5-3f66bd261f67 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.151319 Jan 25 03:39:22.211671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 400/723] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:22 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:23.061895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d9a4d3cf-8f34-496f-977b-490b4552f4f8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:23.063554 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d9a4d3cf-8f34-496f-977b-490b4552f4f8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:23.071709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9a4d3cf-8f34-496f-977b-490b4552f4f8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:23.072167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9a4d3cf-8f34-496f-977b-490b4552f4f8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:23.072989 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9a4d3cf-8f34-496f-977b-490b4552f4f8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:23.073422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d9a4d3cf-8f34-496f-977b-490b4552f4f8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:23.104818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d9a4d3cf-8f34-496f-977b-490b4552f4f8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Jan 25 03:39:23.105387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 324/724] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:23 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:23.232529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:23.233130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:23.240171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:23.240629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:23.241411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:23.241840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:23.380361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:23.388625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:23.395751 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:23.397195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a233f6e5-1db2-432a-a7d8-3c1a7b4efc6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.168344 Jan 25 03:39:23.397757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 401/725] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:23 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:24.116679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7b9a29f7-2551-44ff-854b-18c2d0716fc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:24.117653 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7b9a29f7-2551-44ff-854b-18c2d0716fc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:24.124019 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7b9a29f7-2551-44ff-854b-18c2d0716fc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:24.124472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7b9a29f7-2551-44ff-854b-18c2d0716fc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:24.127559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7b9a29f7-2551-44ff-854b-18c2d0716fc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:24.127559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7b9a29f7-2551-44ff-854b-18c2d0716fc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:24.155199 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7b9a29f7-2551-44ff-854b-18c2d0716fc6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042172 Jan 25 03:39:24.159895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 325/726] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:24 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:39:24.414999 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:24.415772 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:24.422123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:24.422585 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:24.423407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:24.423932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:24.553204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:24.561087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:24.562587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:24.563776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b1a36a3e-fa95-4a90-9737-9ba09d8e7bbb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.152753 Jan 25 03:39:24.564738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 402/727] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:24 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:25.168897 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8699f5b1-6847-4ec8-9961-c0ccc7b940aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:25.169819 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8699f5b1-6847-4ec8-9961-c0ccc7b940aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:25.178278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8699f5b1-6847-4ec8-9961-c0ccc7b940aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:25.179602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8699f5b1-6847-4ec8-9961-c0ccc7b940aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:25.185744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8699f5b1-6847-4ec8-9961-c0ccc7b940aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:25.185744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8699f5b1-6847-4ec8-9961-c0ccc7b940aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:25.214268 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8699f5b1-6847-4ec8-9961-c0ccc7b940aa tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049371 Jan 25 03:39:25.217021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 326/728] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:25 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:25.582420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:25.583022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:25.589135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:25.589588 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:25.590359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:25.590794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:25.723368 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:25.731786 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:25.733255 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:25.734406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f756d040-ce85-400e-b487-23973424ed93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.156366 Jan 25 03:39:25.734951 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 403/729] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:25 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:26.226669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b3dc1b70-f6c8-45d2-8858-7067783f6004 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:26.227601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b3dc1b70-f6c8-45d2-8858-7067783f6004 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:26.233910 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3dc1b70-f6c8-45d2-8858-7067783f6004 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:26.234364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3dc1b70-f6c8-45d2-8858-7067783f6004 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:26.235165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3dc1b70-f6c8-45d2-8858-7067783f6004 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:26.235606 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3dc1b70-f6c8-45d2-8858-7067783f6004 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:26.267560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b3dc1b70-f6c8-45d2-8858-7067783f6004 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Jan 25 03:39:26.268177 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 327/730] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:26 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:26.752851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:26.753444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:26.759908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:26.760367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:26.761235 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:26.761679 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:26.936364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:26.948047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:26.949786 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:26.951584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0e42f6e0-6be9-4b30-b1a6-7391a00119df tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.203022 Jan 25 03:39:26.963160 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 404/731] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:26 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:27.279954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c8a2b3fa-c853-4702-a9a6-b4c39bb4a4a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:27.281456 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c8a2b3fa-c853-4702-a9a6-b4c39bb4a4a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:27.290029 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3fa-c853-4702-a9a6-b4c39bb4a4a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:27.303231 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3fa-c853-4702-a9a6-b4c39bb4a4a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:27.303231 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3fa-c853-4702-a9a6-b4c39bb4a4a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:27.303231 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c8a2b3fa-c853-4702-a9a6-b4c39bb4a4a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:27.325589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c8a2b3fa-c853-4702-a9a6-b4c39bb4a4a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049717 Jan 25 03:39:27.330752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 328/732] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:27 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:27.969872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:27.971358 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:27.982954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:27.983566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:27.984293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:27.984741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:28.163546 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:28.172034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:28.175694 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:28.177627 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-549195ea-c260-42c3-99b5-20803e463069 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.211505 Jan 25 03:39:28.178445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 405/733] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:27 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:28.339952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1d9a7ba0-d898-400f-a313-3f4851199ba8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:28.342047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1d9a7ba0-d898-400f-a313-3f4851199ba8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:28.364412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d9a7ba0-d898-400f-a313-3f4851199ba8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:28.365138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d9a7ba0-d898-400f-a313-3f4851199ba8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:28.372304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d9a7ba0-d898-400f-a313-3f4851199ba8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:28.373007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d9a7ba0-d898-400f-a313-3f4851199ba8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:28.466773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1d9a7ba0-d898-400f-a313-3f4851199ba8 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131661 Jan 25 03:39:28.467337 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 329/734] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:28 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:29.197737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:29.198489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:29.205135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:29.205522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:29.206319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:29.206760 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:29.374239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:29.390813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:29.396912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:29.396912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bf642924-309e-4117-baeb-0c2f86f67abd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.201511 Jan 25 03:39:29.396912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 406/735] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:29 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:29.478396 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-84777ae0-25f5-442b-a335-c537d3a4d4ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:29.480226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-84777ae0-25f5-442b-a335-c537d3a4d4ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:29.488106 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84777ae0-25f5-442b-a335-c537d3a4d4ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:29.488648 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84777ae0-25f5-442b-a335-c537d3a4d4ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:29.489790 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84777ae0-25f5-442b-a335-c537d3a4d4ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:29.490491 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84777ae0-25f5-442b-a335-c537d3a4d4ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:29.528220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-84777ae0-25f5-442b-a335-c537d3a4d4ae tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053719 Jan 25 03:39:29.529168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 330/736] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:29 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:30.414026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:30.414639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:30.421052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:30.421518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:30.422305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:30.422748 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:30.565203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-82114d26-a100-45ab-ae71-ffea03c5bb37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:30.565203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-82114d26-a100-45ab-ae71-ffea03c5bb37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:30.565203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82114d26-a100-45ab-ae71-ffea03c5bb37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:30.565203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82114d26-a100-45ab-ae71-ffea03c5bb37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:30.565882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82114d26-a100-45ab-ae71-ffea03c5bb37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:30.565882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-82114d26-a100-45ab-ae71-ffea03c5bb37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:30.566052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:30.573884 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:30.575414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:30.576565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-24302799-ccd1-4368-bed1-103f9c0ea8f1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.166238 Jan 25 03:39:30.577174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 407/737] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:30 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:30.587791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-82114d26-a100-45ab-ae71-ffea03c5bb37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051497 Jan 25 03:39:30.588338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 331/738] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:39:30 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 25 03:39:31.594242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:31.595781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:31.601944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:31.602403 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:31.603227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:31.603671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:31.741487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:31.749649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:31.752034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:31.753785 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-44c48d24-08d9-4d18-8b8f-0a7dfe952f59 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.163408 Jan 25 03:39:31.757990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 408/739] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:31 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:32.777045 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:32.777557 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:32.784784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:32.785236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:32.786376 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:32.786979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:32.946519 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:32.955320 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:32.957198 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:32.958470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b6afdfdb-359e-4c65-bda7-2e009ee58b3e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.185390 Jan 25 03:39:32.959027 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 332/740] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:32 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:33.976855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:33.977463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:33.983858 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:33.984318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:33.985095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:33.986156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:34.127410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:34.135769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:34.137328 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:34.138538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f5756b95-3308-4f5c-8c34-e67c8a34dd55 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.165322 Jan 25 03:39:34.139366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 409/741] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:33 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:35.161546 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:35.162794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:35.177574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:35.180254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:35.182573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:35.184920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:35.363028 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:35.374588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:35.376180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:35.377943 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-59179e4e-6662-4194-955f-17179e4cf65e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.222951 Jan 25 03:39:35.380498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 333/742] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:35 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:36.396056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:36.397538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:36.404310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:36.407597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:36.407597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:36.407597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:36.577672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:36.589934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:36.591451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:36.592814 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9ea91d2c-9c09-4126-9a7c-0bfd3bc1364e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.200853 Jan 25 03:39:36.593958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 410/743] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:36 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:37.612898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:37.613527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:37.619941 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:37.620439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:37.621266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:37.621704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:37.761261 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:37.770795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:37.770795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:37.771755 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e25b29e1-24d3-454e-b5b2-503ce8aaeb51 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.163802 Jan 25 03:39:37.782085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 334/744] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:37 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:38.789323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:38.789930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:38.796287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:38.796737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:38.797506 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:38.797940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:38.951850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:38.960784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:38.962275 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:38.963478 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3a1f871f-6e1d-4353-bc7d-cc4ba8d430b7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.177783 Jan 25 03:39:38.964050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 411/745] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:38 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:39.433863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:39.434341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:39.440781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:39.441234 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:39.442012 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:39.442450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:39.467385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:39:39.763184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-319545a5-d662-4429-910c-83c1040a860e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 204 len: 0 microversion: 2.1 time: 0.332585 Jan 25 03:39:39.763703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 335/746] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:39:39 2022] DELETE /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:39:39.772199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:39.772836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:39.779234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:39.779686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:39.781013 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:39.781013 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:39.914134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:39.921487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-22733e9a-1502-4bec-9b81-99379750d269 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1518 microversion: 2.1 time: 0.152975 Jan 25 03:39:39.927171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 412/747] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:39 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:39.982103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:39.982831 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:39.988867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:39.989391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:39.990173 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:39.990615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:40.118434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:40.126020 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:40.128573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:40.129720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-db0a27a2-4025-4000-b82e-f3e154916b5a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.151675 Jan 25 03:39:40.130274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 336/748] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:39 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:40.938295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:40.939514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:40.946198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:40.946653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:40.947465 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:40.947906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:41.075187 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:41.082875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5a2c8644-435b-484c-b1a8-244a8643f8c3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1518 microversion: 2.1 time: 0.148319 Jan 25 03:39:41.083474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 413/749] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:40 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:41.147649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:41.148253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:41.154508 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:41.154965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:41.155776 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:41.156219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:41.293518 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:41.302007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:41.303560 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:41.304983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4265cb30-e1cf-4c6b-96f7-5034484454dd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.161009 Jan 25 03:39:41.305538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 337/750] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:41 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:42.099770 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:42.100380 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:42.106578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:42.107029 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:42.107842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:42.108279 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:42.239367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:42.246783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-671c5145-d918-4cc4-a663-f1f54b5dfc63 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1518 microversion: 2.1 time: 0.150660 Jan 25 03:39:42.247391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 414/751] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:42 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:42.322850 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:42.323507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:42.330629 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:42.331129 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:42.331923 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:42.332421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:42.460929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:42.468619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:42.470911 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:42.472099 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f1f289a5-86b6-4bbd-88d8-e01674f00124 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.153245 Jan 25 03:39:42.472674 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 338/752] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:42 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:43.264104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:43.265271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:43.271991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:43.272452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:43.273237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:43.273682 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:43.405757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:43.413886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-845fdc49-a3ec-49c8-8062-506335a87b82 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1518 microversion: 2.1 time: 0.153469 Jan 25 03:39:43.414455 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 415/753] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:43 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:43.489602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:43.490192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:43.496414 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:43.496868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:43.497642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:43.498082 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:43.632928 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:43.640613 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:43.642822 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:43.644122 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-169ac835-c859-4078-a5dd-72a74ee1e410 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.158314 Jan 25 03:39:43.644678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 339/754] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:43 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:44.430065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:44.430703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:44.438058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:44.438520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:44.440262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:44.440689 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:44.588472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:44.596117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6581e3c6-6f07-4a64-bf88-fe806338bcbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1518 microversion: 2.1 time: 0.169838 Jan 25 03:39:44.596630 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 416/755] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:44 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:44.662475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:44.663116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:44.670188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:44.670864 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:44.671922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:44.672357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:44.806698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:44.814659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:44.816235 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:44.817362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1b8b9737-5e8c-452b-a0f7-1d4cddfd0aef tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1743 microversion: 2.20 time: 0.158731 Jan 25 03:39:44.817924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 340/756] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:44 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:45.612435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:45.612980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:45.619259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:45.619716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:45.620486 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:45.620926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:45.760533 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:45.769405 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7c40df1f-1017-41df-b99b-e77c1175a795 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1518 microversion: 2.1 time: 0.160630 Jan 25 03:39:45.770166 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 417/757] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:45 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:45.835524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:45.836226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:45.842524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:45.845452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:45.845452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:45.845452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:46.079679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:46.087484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:46.088957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:46.090147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-54336acc-e8d7-4f0c-92ab-f90fb2c937e6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.258232 Jan 25 03:39:46.090706 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 341/758] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:45 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:46.795428 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:46.796134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:46.804098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:46.804558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:46.806878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:46.806878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:46.874543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:46.883346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-df646855-4768-469b-ae6b-b810404b01df tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1476 microversion: 2.1 time: 0.091446 Jan 25 03:39:46.884168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 418/759] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:46 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1476 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:46.887672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-4e2bedbb-31b4-4dfb-8616-02312b80e78b req-9624b233-ceba-4a45-b003-1be6f5ab10c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe745e9c-07ae-4b28-a900-c80c2483da22", "name": "network-vif-deleted", "tag": "4fb97a43-a6b7-44dd-bde5-dba0bb60c4f0"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:39:46.890682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:39:46.890682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:39:46.897075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4e2bedbb-31b4-4dfb-8616-02312b80e78b req-9624b233-ceba-4a45-b003-1be6f5ab10c7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:46.897526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4e2bedbb-31b4-4dfb-8616-02312b80e78b req-9624b233-ceba-4a45-b003-1be6f5ab10c7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:46.908998 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-4e2bedbb-31b4-4dfb-8616-02312b80e78b req-9624b233-ceba-4a45-b003-1be6f5ab10c7 service nova] Creating event network-vif-deleted:4fb97a43-a6b7-44dd-bde5-dba0bb60c4f0 for instance fe745e9c-07ae-4b28-a900-c80c2483da22 on hv-cinder-81901 Jan 25 03:39:46.914074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-4e2bedbb-31b4-4dfb-8616-02312b80e78b req-9624b233-ceba-4a45-b003-1be6f5ab10c7 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 Jan 25 03:39:46.914744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 342/760] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:39:47.109655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:47.110706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:47.117385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:47.117838 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:47.118633 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:47.119096 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:47.253228 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:47.262951 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:47.264715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:47.265878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d75e339a-6ab1-421b-a341-ad3d344bb2f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.161088 Jan 25 03:39:47.267517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 419/761] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:47 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:47.901318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:47.902004 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:47.909339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:47.909835 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:47.910620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:47.911050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:47.976809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:47.984077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cd402999-d740-4b83-8b59-4e5d7a1141a6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1307 microversion: 2.1 time: 0.087374 Jan 25 03:39:47.985545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 343/762] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:47 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:48.284948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:48.285692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:48.291886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:48.292352 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:48.293122 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:48.293562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:48.454756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:48.462466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:48.463994 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:48.465149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4dd0c8d9-a752-4cf2-8864-65b2d6b5ea56 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.184091 Jan 25 03:39:48.465810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 420/763] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:48 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:49.001115 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:49.001738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:49.007983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:49.008421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:49.009180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:49.009607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:49.068083 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:49.075650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f7d3aeb6-15b0-4735-9c24-1ab7edebd183 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1307 microversion: 2.1 time: 0.078370 Jan 25 03:39:49.076211 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 344/764] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:48 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1307 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:49.482925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:49.483590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:49.490386 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:49.490838 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:49.491655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:49.492149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:49.827782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:49.836699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:49.838291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:49.839578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9d122faa-63b3-4622-b599-a5b68c4814c3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.360312 Jan 25 03:39:49.840133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 421/765] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:49 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:50.092634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:50.093299 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:50.100424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:50.100878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:50.104497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:50.108818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:50.168778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:50.176733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c401fe7a-d0c9-41dd-ad00-e0397e757d61 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1307 microversion: 2.1 time: 0.087892 Jan 25 03:39:50.177304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 345/766] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:50 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:50.857548 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:50.858291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:50.864880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:50.865336 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:50.866112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:50.866548 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:50.999118 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:51.007486 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:51.008977 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:51.010129 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-91aa8273-4e70-4789-b93f-b4ca6fcd4806 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.156365 Jan 25 03:39:51.010684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 422/767] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:50 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:51.193063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:51.193925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:51.200426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:51.200869 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:51.201637 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:51.202067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:51.260186 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:51.267721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-294fbd18-474b-48f1-97d1-a68d150fca0e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1307 microversion: 2.1 time: 0.078110 Jan 25 03:39:51.268467 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 346/768] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:51 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1307 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:52.028198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:52.028841 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:52.035345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:52.035807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:52.036597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:52.037046 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:52.177875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:52.185590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:52.194718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:52.194718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3cb7819e-fafe-46b5-9525-8500f98b19c9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.163772 Jan 25 03:39:52.194718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 423/769] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:52 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:52.283999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:52.284596 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:52.290408 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:52.290854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:52.291648 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:52.292079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:52.355307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:52.362982 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1927da68-9709-4fe9-8b55-5f9f6dc20688 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1307 microversion: 2.1 time: 0.083211 Jan 25 03:39:52.364000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 347/770] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:52 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1307 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:53.206809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:53.207449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:53.213705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:53.214163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:53.214946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:53.215411 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:53.356468 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:53.365930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:53.367700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:53.372672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b6f81773-6c51-48c8-8695-e4e3f121ac00 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.166524 Jan 25 03:39:53.372672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 424/771] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:53 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:53.381977 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:53.383380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:53.391041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:53.392110 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:53.393013 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:53.393447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:53.470337 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:53.478405 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f46bcf25-6e87-409d-94b2-04f7b4545c93 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1307 microversion: 2.1 time: 0.100430 Jan 25 03:39:53.488045 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 348/772] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:53 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:53.564287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-a33df6d4-b0b1-44eb-b36d-dd3f5591601e req-cfa6f12a-9984-4b58-bc57-9ce5cb0ae0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c1179f-67c0-4198-8933-7cabe5c964f3", "name": "network-vif-unplugged", "status": "completed", "tag": "23790178-4f79-4bcf-a17f-bd8e5abf0427"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:39:53.566171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:39:53.566171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:39:53.575605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a33df6d4-b0b1-44eb-b36d-dd3f5591601e req-cfa6f12a-9984-4b58-bc57-9ce5cb0ae0ff service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:53.575974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a33df6d4-b0b1-44eb-b36d-dd3f5591601e req-cfa6f12a-9984-4b58-bc57-9ce5cb0ae0ff service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:53.588050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-a33df6d4-b0b1-44eb-b36d-dd3f5591601e req-cfa6f12a-9984-4b58-bc57-9ce5cb0ae0ff service nova] Creating event network-vif-unplugged:23790178-4f79-4bcf-a17f-bd8e5abf0427 for instance b5c1179f-67c0-4198-8933-7cabe5c964f3 on hv-cinder-81901 Jan 25 03:39:53.593626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-a33df6d4-b0b1-44eb-b36d-dd3f5591601e req-cfa6f12a-9984-4b58-bc57-9ce5cb0ae0ff service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033190 Jan 25 03:39:53.594218 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 425/773] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:39:54.389518 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:54.390121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:54.397136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:54.397581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:54.398347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:54.398786 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:54.496358 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:54.497065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:54.504082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:54.504583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:54.505370 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:54.505844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:54.536764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:54.537228 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:54.537674 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid fe745e9c-07ae-4b28-a900-c80c2483da22 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:39:54.539843 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:54.548139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:54.550340 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:54.551543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-83826cd0-e4ea-45ab-990a-426d631ac2bb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.165764 Jan 25 03:39:54.552111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 349/774] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:54 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:54.577739 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:54.585185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5b97df2d-08a5-401a-b6e4-37b27581b1cb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 200 len: 1312 microversion: 2.1 time: 0.093462 Jan 25 03:39:54.585747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 426/775] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:54 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:55.570078 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:55.570690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:55.576986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:55.577442 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:55.578220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:55.578659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:55.601477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:55.602182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: fe745e9c-07ae-4b28-a900-c80c2483da22] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:55.608499 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:55.608894 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:55.609671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:55.610114 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:55.623366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] HTTP exception thrown: Instance fe745e9c-07ae-4b28-a900-c80c2483da22 could not be found. Jan 25 03:39:55.623964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Returning 404 to user: Instance fe745e9c-07ae-4b28-a900-c80c2483da22 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:39:55.624825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9cd74221-aaf3-4621-83e0-51895cf071a1 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22" status: 404 len: 111 microversion: 2.1 time: 0.026966 Jan 25 03:39:55.625373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 427/776] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:55 2022] GET /compute/v2.1/servers/fe745e9c-07ae-4b28-a900-c80c2483da22 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 25 03:39:55.723729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:55.731824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:55.733307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:55.734451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-57388fd1-aeaf-4647-9494-63b0001088a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1725 microversion: 2.20 time: 0.168352 Jan 25 03:39:55.735008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 350/777] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:55 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:56.752878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:56.755468 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:56.760101 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:56.760646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:56.761425 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:56.761857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:56.905644 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:56.913599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:56.915130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:56.916370 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a4cad701-af48-4d29-b740-f1367017c479 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1728 microversion: 2.20 time: 0.167814 Jan 25 03:39:56.916932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 428/778] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:56 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:56.934932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-58c556bb-6831-4533-9fa5-f6bbf3c4213c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ffed6ed-ee6c-4bb6-a2e9-27ac1dfbf832"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:39:56.935998 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-58c556bb-6831-4533-9fa5-f6bbf3c4213c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:56.942436 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58c556bb-6831-4533-9fa5-f6bbf3c4213c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:56.942877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58c556bb-6831-4533-9fa5-f6bbf3c4213c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:56.943976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58c556bb-6831-4533-9fa5-f6bbf3c4213c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:56.944405 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58c556bb-6831-4533-9fa5-f6bbf3c4213c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:57.973197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:57.973733 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:57.980917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:57.981377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:57.982524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:57.982624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:57.986019 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-58c556bb-6831-4533-9fa5-f6bbf3c4213c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.054894 Jan 25 03:39:57.987612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 351/779] 10.222.0.115 () {62 vars in 1368 bytes} [Tue Jan 25 03:39:56 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments => generated 188 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:39:58.012842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:39:58.113963 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-538822a6-5f46-4c03-b070-142627f6bcf6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:39:58.114659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-538822a6-5f46-4c03-b070-142627f6bcf6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:58.121970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-538822a6-5f46-4c03-b070-142627f6bcf6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:58.122425 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-538822a6-5f46-4c03-b070-142627f6bcf6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:58.123371 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-538822a6-5f46-4c03-b070-142627f6bcf6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:58.123820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-538822a6-5f46-4c03-b070-142627f6bcf6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:58.329872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-332a9cb8-ea3a-4c56-b7fa-c57ef8c88391 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 204 len: 0 microversion: 2.1 time: 0.360299 Jan 25 03:39:58.330480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 429/780] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:39:57 2022] DELETE /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 25 03:39:58.339929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:58.340726 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:58.351920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:58.352383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:58.353461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:58.353901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:58.377704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-538822a6-5f46-4c03-b070-142627f6bcf6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action" status: 202 len: 0 microversion: 2.20 time: 0.268386 Jan 25 03:39:58.384399 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 352/781] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:39:58 2022] POST /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:39:58.389442 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:58.390049 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:58.402802 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:58.403601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:58.404504 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:58.404947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:58.538954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:58.547456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c98069da-7fe3-4c46-839f-a239ac65f6d9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1517 microversion: 2.1 time: 0.211464 Jan 25 03:39:58.548113 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 430/782] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:58 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:39:58.595241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:58.610153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:58.614343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:58.614343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5847ac82-8d06-4f8a-8489-61e840ddaf9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1754 microversion: 2.20 time: 0.227961 Jan 25 03:39:58.614663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 353/783] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:58 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1754 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:39:59.574739 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:59.575528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:59.582211 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:59.582656 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:59.583573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:59.584012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:59.633741 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:39:59.634458 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:39:59.641349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:59.641809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:59.642691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:39:59.643202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:39:59.722818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:59.730158 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c1d642a0-fc3f-4455-9ce8-59138c04d133 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1517 microversion: 2.1 time: 0.168265 Jan 25 03:39:59.730730 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 431/784] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:39:59 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:39:59.795169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:59.804249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:59.805757 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:39:59.806897 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-633e17ce-6fa4-4e4a-b151-ad1d46368262 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1754 microversion: 2.20 time: 0.177733 Jan 25 03:39:59.807481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 354/785] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:39:59 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:00.752850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:00.753453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:00.759361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:00.759811 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:00.760579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:00.761009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:00.830470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:00.831105 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:00.837728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:00.838345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:00.839840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:00.840647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:00.900605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:00.908911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6195e778-3741-4a1b-b3dd-29dc85c5cd44 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1517 microversion: 2.1 time: 0.160125 Jan 25 03:40:00.909630 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 432/786] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:00 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:00.975508 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:00.983690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:00.985192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:00.986345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5af57dd8-1a9f-42f6-802d-53cddaa23d87 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1754 microversion: 2.20 time: 0.160478 Jan 25 03:40:00.986914 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 355/787] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:00 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:01.925691 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:01.926301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:01.932711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:01.933189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:01.933954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:01.934395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:02.004321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:02.005500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:02.011213 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:02.011667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:02.012507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:02.012944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:02.070050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:02.077276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-67b0a92d-bb52-4aca-abcc-e3a8e0528126 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1517 microversion: 2.1 time: 0.155571 Jan 25 03:40:02.077849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 433/788] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:01 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:02.145003 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:02.154535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:02.155402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:02.156559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-175b9ebb-3dca-4d85-9f08-c53cdc236b5d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1754 microversion: 2.20 time: 0.156258 Jan 25 03:40:02.157177 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 356/789] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:01 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:03.094005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:03.095353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:03.104972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:03.104972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:03.104972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:03.104972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:03.175889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:03.177327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:03.183870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:03.188059 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:03.188059 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:03.188059 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:03.238981 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:03.246661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4e67e271-8752-47ff-8230-c54984fdb27e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1517 microversion: 2.1 time: 0.156344 Jan 25 03:40:03.247365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 434/790] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:03 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:03.317725 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:03.326577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:03.328098 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:03.329964 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-be17e986-29d5-4d1d-bbeb-847d76785a15 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.158682 Jan 25 03:40:03.330509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 357/791] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:03 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:04.263227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:04.263842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:04.270872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:04.271358 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:04.272149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:04.272591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:04.349141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:04.350427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:04.357350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:04.357801 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:04.358744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:04.359223 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:04.410720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:04.418306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a0ea5cb6-8bad-49ba-b47b-b75039aff253 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1517 microversion: 2.1 time: 0.158674 Jan 25 03:40:04.418888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 435/792] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:04 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:04.490877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:04.502384 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:04.502384 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:04.502384 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e5e35e2d-f1a0-4571-9b3b-fed22f7bd551 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.157599 Jan 25 03:40:04.502724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 358/793] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:04 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:05.434570 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:05.435433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:05.442466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:05.442919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:05.443981 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:05.444420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:05.520829 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:05.521808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:05.529590 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:05.530328 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:05.532393 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:05.539314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:05.586789 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:05.594529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-207482df-2a06-4d66-84f5-24b0dbb6a22e tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1517 microversion: 2.1 time: 0.163670 Jan 25 03:40:05.595127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 436/794] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:05 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:05.776891 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:05.787789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:05.789368 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:05.790726 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-39426f91-954f-489b-bea6-a8f262850eed tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.274843 Jan 25 03:40:05.791410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 359/795] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:05 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:06.165113 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-12ea4ca9-7a3f-4990-8f44-78c2aac688d9 req-8cdc8943-9d44-4b59-8447-aa225c655646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c1b7caf-2414-4373-a49c-b8374358d3f3", "name": "network-vif-deleted", "tag": "06409dab-f866-4e30-91b3-02bed40f3fbc"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:06.167215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:40:06.167215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:40:06.175620 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-12ea4ca9-7a3f-4990-8f44-78c2aac688d9 req-8cdc8943-9d44-4b59-8447-aa225c655646 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.176221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-12ea4ca9-7a3f-4990-8f44-78c2aac688d9 req-8cdc8943-9d44-4b59-8447-aa225c655646 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.196551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-12ea4ca9-7a3f-4990-8f44-78c2aac688d9 req-8cdc8943-9d44-4b59-8447-aa225c655646 service nova] Creating event network-vif-deleted:06409dab-f866-4e30-91b3-02bed40f3fbc for instance 9c1b7caf-2414-4373-a49c-b8374358d3f3 on hv-cinder-81901 Jan 25 03:40:06.196551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-12ea4ca9-7a3f-4990-8f44-78c2aac688d9 req-8cdc8943-9d44-4b59-8447-aa225c655646 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034798 Jan 25 03:40:06.196551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 437/796] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:40:06.611472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:06.612177 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:06.618450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.618903 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.619758 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.620191 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.652241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.652883 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.653498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:06.697764 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:06.705689 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e055dbf4-38a9-4a43-a509-ffc460092f8b tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.097511 Jan 25 03:40:06.706276 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 360/797] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:06 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:06.810459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:06.865056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:06.865056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.865056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.865056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.866361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.926484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:06.931801 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:06.933464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.934102 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.935781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:06.936387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:06.967463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:06.968311 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:06.969828 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:06.974472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e85f006b-4f12-4098-af48-14ed1d677405 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.168444 Jan 25 03:40:06.975427 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 438/798] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:06 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:07.013211 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-586677170", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1048410455", "security_groups": [{"name": "tempest-secgroup-smoke-63611146"}], "block_device_mapping_v2": [{"uuid": "65a000be-6abc-4491-abc3-e1d420be4ce9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ff74d41-8997-4f13-a353-f1aafd7e012e"}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:07.037752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lazy-loading 'services' on Instance uuid 17671564-7d41-4c30-b928-409b5a40f3a7 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:07.138452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] validate_networks() for [('0ff74d41-8997-4f13-a353-f1aafd7e012e', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:40:07.264897 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cd438e06-0dd3-4e2e-8aec-50b0b157077b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "DELETE /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7/os-volume_attachments/31d3f0f4-8919-4b7a-b643-63fd887e2c52" status: 202 len: 0 microversion: 2.1 time: 0.343009 Jan 25 03:40:07.265500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 361/799] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:40:06 2022] DELETE /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7/os-volume_attachments/31d3f0f4-8919-4b7a-b643-63fd887e2c52 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:40:07.496059 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:40:07.496474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:40:07.496946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:40:07.497352 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:40:07.497760 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:40:07.506717 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:07.507215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:07.508019 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:07.508451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:07.524735 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for project 0fe72d0d8d144438a671aac4e939c693. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:40:07.528586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for user 792e6b0c7c4946ed88fbc454b1779485 and project 0fe72d0d8d144438a671aac4e939c693. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:40:07.583706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:40:07.585832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65a000be-6abc-4491-abc3-e1d420be4ce9',volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:40:07.723842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:07.724493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:07.730582 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:07.731032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:07.732305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:07.732305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:07.762555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:07.771187 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:07.771187 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:07.811352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:07.819468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-093ee851-27e8-4969-9e67-2eee3da848e6 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.100417 Jan 25 03:40:07.820032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 362/800] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:07 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:07.983890 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [d9d2a907-ccbe-4b77-9151-0259694afb7d] AMQP server on 10.222.0.115:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 25 03:40:07.993272 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:07.993994 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:07.999778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:08.000459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:08.000973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:08.001407 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:08.130289 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:08.138628 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:08.140147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:08.141291 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3c6d5848-5f54-4d85-aaed-d52bb25d952b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.151673 Jan 25 03:40:08.141860 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 363/801] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:07 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:08.836061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:08.836640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:08.843107 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:08.843550 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:08.844344 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:08.844780 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:08.877918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:08.878363 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:08.878803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:08.917492 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:08.924790 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8d260a85-fba0-47d5-a6ff-817ecc922be3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.092402 Jan 25 03:40:08.925353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 364/802] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:08 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:08.991253 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [d9d2a907-ccbe-4b77-9151-0259694afb7d] Reconnected to AMQP server on 10.222.0.115:5672 via [amqp] client with port 60622. Jan 25 03:40:08.995099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bfbfec85-281e-4a6b-a376-06a8d8ff9391 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.985718 Jan 25 03:40:08.995752 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 439/803] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:40:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1987 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 25 03:40:09.006247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5e9898e9-0b81-47f2-be1b-3adde1c89782 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:09.006892 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5e9898e9-0b81-47f2-be1b-3adde1c89782 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:09.061166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5e9898e9-0b81-47f2-be1b-3adde1c89782 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:09.068649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5e9898e9-0b81-47f2-be1b-3adde1c89782 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1097 microversion: 2.1 time: 0.066815 Jan 25 03:40:09.069219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 365/804] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:09 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1097 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:09.160038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:09.160642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:09.166601 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:09.167065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:09.167854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:09.168290 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:09.297225 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:09.305494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:09.306976 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:09.308145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-063ec945-9a7f-4618-88ca-50e9b4e6a9c5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.152447 Jan 25 03:40:09.308701 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 440/805] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:09 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:09.941761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:09.942362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:09.948800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:09.949293 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:09.950056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:09.950483 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:09.980720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:09.981161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:09.981602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:10.020178 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:10.027338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1a1c49b4-cfbe-4cbc-a882-88bbced913b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.089899 Jan 25 03:40:10.027894 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 366/806] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:09 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:10.085366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:10.085980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:10.092470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:10.092928 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:10.093714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:10.094153 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:10.152557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:10.160144 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5084f19e-2fb1-4dfd-939a-8bb4433b79ce tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1147 microversion: 2.1 time: 0.078466 Jan 25 03:40:10.160709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 441/807] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:10 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1147 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:10.326373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:10.326909 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:10.333023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:10.333473 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:10.334249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:10.334688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:10.465307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:10.474307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:10.475821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:10.477408 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c873e297-2a8f-4e71-9258-0d36ee124a68 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.154336 Jan 25 03:40:10.477693 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 367/808] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:10 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:11.043586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:11.044125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:11.050876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:11.051371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:11.052155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:11.052597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:11.083083 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:11.083552 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:11.084005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:11.121712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:11.129625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ab31965d-222d-4e02-a239-2a6100905afd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.089842 Jan 25 03:40:11.130198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 442/809] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:11 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:11.178367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:11.178976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:11.185253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:11.185695 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:11.186456 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:11.186879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:11.244030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:11.251038 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2128c650-5499-49ee-9d9f-ee106093fea2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1147 microversion: 2.1 time: 0.077272 Jan 25 03:40:11.252151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 368/810] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:11 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1147 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:11.495182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:11.495797 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:11.502353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:11.502927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:11.503752 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:11.504199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:11.632685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:11.640803 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:11.643097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:11.644267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3b9565bd-ece9-4e61-a78c-1d90d9538d3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.153033 Jan 25 03:40:11.644834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 443/811] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:11 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:12.148964 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:12.149498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:12.155346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:12.155796 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:12.156568 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:12.156999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:12.187406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:12.188006 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:12.188279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:12.231924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:12.239803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ed3b929c-e681-4ec6-975c-4cdb65d26ab4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.094582 Jan 25 03:40:12.240369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 369/812] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:12 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:12.267629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:12.268281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:12.274527 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:12.275011 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:12.275811 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:12.276247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:12.333978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:12.341224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0bd688e2-fd1d-46ac-8b28-5a49ae238746 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1147 microversion: 2.1 time: 0.077945 Jan 25 03:40:12.343300 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 444/813] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:12 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1147 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:12.662421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:12.663030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:12.668905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:12.669346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:12.670104 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:12.670535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:12.798186 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:12.807506 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:12.808992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:12.810133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8d97c907-0d33-4e23-ba6a-ccc7c1736f23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1756 microversion: 2.20 time: 0.152149 Jan 25 03:40:12.810688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 370/814] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:12 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1756 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:13.255953 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:13.256567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:13.263221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:13.263684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:13.264452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:13.264897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:13.296960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:13.297663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:13.297855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:13.338567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:13.346526 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6c0b743c-0931-44a9-88cf-c7859eb0c4b3 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.094184 Jan 25 03:40:13.355945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 445/815] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:13 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:13.358056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:13.358768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:13.365719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:13.366492 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:13.367428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:13.367965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:13.432698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:13.440975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a0ce2e9d-ea4e-4171-9c03-8ee8bfff6f64 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1147 microversion: 2.1 time: 0.087153 Jan 25 03:40:13.441563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 371/816] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:13 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1147 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:13.828291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:13.828890 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:13.835173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:13.835583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:13.836372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:13.836816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:13.966197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:13.974660 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:13.976169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:13.977474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-01b3bcfa-a395-42af-858f-49d619a916ff tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.152704 Jan 25 03:40:13.978084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 446/817] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:13 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:14.363577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:14.364176 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:14.370535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:14.370976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:14.371792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:14.372391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:14.402662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:14.403130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:14.403581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid 9c1b7caf-2414-4373-a49c-b8374358d3f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:14.443964 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:14.451626 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d8ad72dd-db2c-4062-ba8b-5af30c149844 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 200 len: 1311 microversion: 2.1 time: 0.092356 Jan 25 03:40:14.452212 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 372/818] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:14 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:14.458389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:14.459478 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:14.465333 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:14.465807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:14.466581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:14.467025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:14.529061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:14.536534 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-21ed69e4-bd23-4f52-928a-34ed0d8cce48 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1195 microversion: 2.1 time: 0.082488 Jan 25 03:40:14.537097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 447/819] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:14 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1195 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:14.996577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:14.998451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:15.004149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.004609 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.008035 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.008953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.304382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:15.312663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:15.314891 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:15.316182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-38afbb54-d59b-4994-96ee-bf673609b6d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.324142 Jan 25 03:40:15.316754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 373/820] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:14 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:15.468714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:15.469326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: 9c1b7caf-2414-4373-a49c-b8374358d3f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:15.476024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.476480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.477266 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.477703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.496969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] HTTP exception thrown: Instance 9c1b7caf-2414-4373-a49c-b8374358d3f3 could not be found. Jan 25 03:40:15.497533 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Returning 404 to user: Instance 9c1b7caf-2414-4373-a49c-b8374358d3f3 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:40:15.498771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8e2a73db-0e85-4288-ae61-4336433ce50f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3" status: 404 len: 111 microversion: 2.1 time: 0.033402 Jan 25 03:40:15.499248 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 448/821] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:15 2022] GET /compute/v2.1/servers/9c1b7caf-2414-4373-a49c-b8374358d3f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:40:15.508144 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:15.508885 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:15.515665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.516106 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.517134 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.517791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.544389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:40:15.553643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:15.554259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:15.560556 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.561032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.561830 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.562277 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.625487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:15.633493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0dbd3955-84c7-473b-b5cc-00f234e99f5f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1213 microversion: 2.1 time: 0.083379 Jan 25 03:40:15.634068 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 449/822] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:15 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:15.878985 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6a4e2422-b01c-408f-b13e-27bed16391ed tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 204 len: 0 microversion: 2.1 time: 0.374540 Jan 25 03:40:15.879809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 374/823] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:40:15 2022] DELETE /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 25 03:40:15.892833 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:15.893457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:15.900074 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.900532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:15.904203 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:15.904713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:16.051565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:16.063317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-83a3c927-f65a-4861-af9f-b3b1e80f23a2 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.175312 Jan 25 03:40:16.063317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 450/824] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:15 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:16.335096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:16.335802 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:16.343410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:16.344046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:16.345008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:16.346451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:16.643942 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:16.651801 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:16.653061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:16.661640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:16.664823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:16.664823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c9e7205f-fd3f-47b7-8803-c2d494200d76 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.334116 Jan 25 03:40:16.665148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:16.665923 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:16.666952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:16.667651 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:16.671757 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 375/825] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:16 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:16.888620 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:16.897300 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d2d8c00c-8779-4ce2-8692-a1fa6135eff1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.249707 Jan 25 03:40:16.912374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 451/826] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:16 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:17.079391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:17.081060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:17.136589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:17.136589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:17.136589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:17.136589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:17.316103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:17.331782 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-39d2dde2-b00a-49c0-a6ae-2493fa301596 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.257207 Jan 25 03:40:17.332522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 376/827] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:17 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:17.446242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-1580e486-4d25-46eb-ad3e-2978d2a4f66b req-de1efc5d-03d5-45e9-82c6-f64288876d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac7ea524-7a77-478b-9894-556c2be34d87", "tag": "185f7b43-0027-48fd-9809-01daf6b8ce49"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:17.448146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:40:17.448146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:40:17.463791 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-1580e486-4d25-46eb-ad3e-2978d2a4f66b req-de1efc5d-03d5-45e9-82c6-f64288876d6f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:17.464317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-1580e486-4d25-46eb-ad3e-2978d2a4f66b req-de1efc5d-03d5-45e9-82c6-f64288876d6f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:17.485534 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-1580e486-4d25-46eb-ad3e-2978d2a4f66b req-de1efc5d-03d5-45e9-82c6-f64288876d6f service nova] Creating event network-changed:185f7b43-0027-48fd-9809-01daf6b8ce49 for instance ac7ea524-7a77-478b-9894-556c2be34d87 on hv-cinder-81901 Jan 25 03:40:17.503299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-1580e486-4d25-46eb-ad3e-2978d2a4f66b req-de1efc5d-03d5-45e9-82c6-f64288876d6f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060727 Jan 25 03:40:17.508892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 452/828] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:40:17.691334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:17.692048 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:17.698616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:17.699000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:17.701360 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:17.701803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:17.853466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:17.863162 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:17.864696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:17.865864 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f0ece9ff-44fa-431c-b8fc-704947b10e7d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.178752 Jan 25 03:40:17.866412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 377/829] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:17 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:17.929042 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:17.929657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:17.935905 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:17.936361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:17.938947 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:17.938947 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:18.127417 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:18.141650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-23ae8adb-ba6e-4b28-b492-5f4494c8d579 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.217207 Jan 25 03:40:18.143164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 453/830] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:17 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:18.349422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:18.350055 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:18.356341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:18.357037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:18.357907 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:18.358420 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:18.507316 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:18.515785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d06b0c40-6f60-421b-ba9a-1d767ab6f01c tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.170725 Jan 25 03:40:18.516367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 378/831] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:18 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:18.886155 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:18.890260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:18.894475 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:18.895334 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:18.896750 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:18.897242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:19.035479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:19.043579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:19.045150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:19.046315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-18092d67-4229-42a7-9306-7741c37e1295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.164803 Jan 25 03:40:19.047103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 454/832] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:18 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:19.159123 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:19.159763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:19.166303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:19.166752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:19.167567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:19.168001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:19.321181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:19.328390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-96079b11-99ec-4165-a0e3-5778d5d5a488 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.173064 Jan 25 03:40:19.328961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 379/833] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:19 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:19.534731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:19.535904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:19.542281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:19.542738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:19.543755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:19.544366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:19.696352 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:19.711889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7d599551-8e5d-422f-974a-3a0718fc2829 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.181843 Jan 25 03:40:19.712956 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 455/834] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:19 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:20.087753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:20.087753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:20.087753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:20.087753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:20.088280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:20.088280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:20.243187 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:20.254937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:20.256424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:20.257469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cd26c710-3b51-4da5-bee4-8ca745e9f37a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.195553 Jan 25 03:40:20.258350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 380/835] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:20 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:20.347190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:20.348423 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:20.367935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:20.368845 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:20.370156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:20.371001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:20.595778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:20.603621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2a715723-58f4-4b12-ae8c-76731aa1306c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.261606 Jan 25 03:40:20.604469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 456/836] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:20 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:20.728592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:20.729198 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:20.734986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:20.735473 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:20.736281 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:20.736724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:20.962626 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:20.981243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9ba60c1c-382d-4ee5-bebb-66130cf111b9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.256331 Jan 25 03:40:20.981843 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 381/837] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:20 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:21.276686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:21.277737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:21.287522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:21.288456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:21.289649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:21.290434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:21.478092 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:21.488850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:21.490458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:21.491922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ee614269-2710-4895-921f-444fd698de3f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.219009 Jan 25 03:40:21.505255 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 457/838] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:21 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:21.622995 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:21.623643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:21.630176 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:21.630626 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:21.631622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:21.632061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:21.774049 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:21.774791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6c705de9-63a4-4842-9b24-61030762912d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.155428 Jan 25 03:40:21.775386 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 382/839] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:21 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:21.999395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:22.000002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:22.008010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:22.010082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:22.010082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:22.010082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:22.207261 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:22.225521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ef5f0b09-685e-48ff-a01e-65d2373e7a8d tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.229609 Jan 25 03:40:22.226632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 458/840] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:21 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:22.510527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:22.511460 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:22.519124 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:22.519861 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:22.521181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:22.521881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:22.677357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:22.685917 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:22.687442 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:22.688600 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b3e56427-38f9-493e-9d09-6a0d944c75d9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.182023 Jan 25 03:40:22.689889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 383/841] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:22 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:22.791966 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:22.792586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:22.799677 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:22.800242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:22.800929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:22.801551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:22.944073 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:22.951288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9d0098c2-4a59-436c-b9ff-032a799d5500 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.162952 Jan 25 03:40:22.951857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 459/842] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:22 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:23.242345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:23.243014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:23.248856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:23.249299 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:23.250470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:23.251107 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:23.380441 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:23.387734 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7d28137a-53ea-4c91-9c53-50b9fc4e7167 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.148987 Jan 25 03:40:23.388305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 384/843] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:23 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:23.707987 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:23.708603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:23.714457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:23.714945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:23.715759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:23.716204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:23.844709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:23.853443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:23.854937 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:23.856121 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-71c7bc06-15f2-40c7-8af4-33f5e22bf381 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.152381 Jan 25 03:40:23.856689 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 460/844] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:23 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:23.967170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:23.967759 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:23.974010 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:23.974452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:23.975263 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:23.975692 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:24.106327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:24.114370 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-611261f8-9c96-4238-98c3-d5579f0679a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.150969 Jan 25 03:40:24.114937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 385/845] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:23 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:24.404693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:24.405459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:24.411444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:24.411907 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:24.412690 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:24.413136 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:24.540901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:24.548805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3230fc7f-803c-4ada-b892-5f6d462d740f tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.147645 Jan 25 03:40:24.549368 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 461/846] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:24 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:24.873807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:24.874416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:24.880640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:24.881092 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:24.881868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:24.882307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:25.024173 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:25.032945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:25.034597 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:25.035862 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6edfc62f-48a5-48cd-b2b1-c1a8c2d8757d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.165752 Jan 25 03:40:25.036432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 386/847] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:24 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:25.131485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:25.132101 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:25.138605 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:25.139090 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:25.139865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:25.140297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:25.286065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:25.298051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a504910a-a05c-4f1c-86c2-c9556a92a449 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.169686 Jan 25 03:40:25.302635 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 462/848] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:25 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:25.566981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:25.567882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:25.573845 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:25.574311 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:25.575349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:25.575852 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:25.723913 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:25.731597 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1e09dd1b-298b-415a-a95c-1038a4d590ec tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.169715 Jan 25 03:40:25.732538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 387/849] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:25 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:26.054439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:26.055675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:26.061883 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:26.062343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:26.063174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:26.064244 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:26.192464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:26.201038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:26.202531 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:26.203996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ae752fba-a7fd-4b4a-9dfb-a9b2aa75356e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.153601 Jan 25 03:40:26.204846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 463/850] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:26 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:26.317032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:26.317958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:26.324393 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:26.324840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:26.325610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:26.326042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:26.463592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:26.471567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1450108b-3ed6-496d-8fdb-5054e39b9561 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.157812 Jan 25 03:40:26.472151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 388/851] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:26 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:26.748911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:26.749552 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:26.756157 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:26.756609 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:26.757385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:26.757824 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:26.886173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:26.893345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fbb3bbb2-3c71-4927-bcd9-d22c48622b58 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.148177 Jan 25 03:40:26.893910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 464/852] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:26 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:27.225196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:27.226863 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:27.237906 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:27.238762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:27.240192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:27.240981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:27.384610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:27.393140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:27.394620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:27.395864 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a56f4311-7106-4c47-be3b-034244457e2c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.177573 Jan 25 03:40:27.396421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 389/853] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:27 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:27.500412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:27.500412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:27.503837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:27.504474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:27.505282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:27.505718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:27.664195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:27.672194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3f8ad00c-3a95-4fe4-8199-ebb8ee28eb53 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.187439 Jan 25 03:40:27.673460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 465/854] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:27 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:27.910271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:27.910889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:27.917730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:27.918104 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:27.918920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:27.919386 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:28.065730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:28.073222 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8c27f9c5-51c5-49fe-95b0-0068640b9bbb tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.167457 Jan 25 03:40:28.073789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 390/855] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:27 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:28.414246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:28.415474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:28.421981 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:28.422532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:28.423547 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:28.424217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:28.575572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:28.585559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:28.587162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:28.588433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3508ceef-3ff7-46ba-944f-b322b62fb781 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.177864 Jan 25 03:40:28.589004 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 466/856] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:28 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:28.688681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:28.689281 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:28.695970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:28.696428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:28.697216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:28.697658 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:28.826219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:28.833900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a0230325-522d-4cdd-8db9-6b73796cf32c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.149027 Jan 25 03:40:28.834464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 391/857] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:28 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:29.089484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:29.090016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:29.096745 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:29.097196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:29.097965 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:29.098398 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:29.240160 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:29.247670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-115cc3ea-789c-4a8e-bcde-2de5e7446ecd tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.161932 Jan 25 03:40:29.248240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 467/858] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:29 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:29.607574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:29.608046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:29.621347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:29.621798 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:29.622593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:29.623016 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:29.763698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:29.772519 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:29.774023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:29.775216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ad8ee318-d4ff-40cc-ade8-222e28541ab9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.171644 Jan 25 03:40:29.776238 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 392/859] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:29 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:29.850851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:29.851674 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:29.858471 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:29.859156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:29.859954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:29.860936 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:30.014188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:30.022032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f27afea3-6b42-4c6b-bc15-a7f365b06af2 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.175165 Jan 25 03:40:30.022791 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 468/860] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:29 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:30.264431 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:30.265031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:30.273236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:30.273683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:30.274447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:30.274878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:30.430026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:30.437191 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a71e7516-9bb8-4cfe-8482-fcf429dea493 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.176437 Jan 25 03:40:30.437797 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 393/861] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:30 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:30.793837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:30.794684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:30.803134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:30.803134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:30.803364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:30.803794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:30.952323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:30.961674 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:30.964028 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:30.965365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-892c5690-c9e1-4e3c-92bd-39d39f77b407 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.175092 Jan 25 03:40:30.966044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 469/862] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:30 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:31.038844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:31.039961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:31.045987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:31.046353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:31.047110 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:31.047675 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:31.309743 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:31.318292 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f7acb360-27c7-4a0c-af69-8fd13eb4c52f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.283133 Jan 25 03:40:31.319075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 394/863] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:31 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:31.454252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:31.454913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:31.460911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:31.461365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:31.462245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:31.462679 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:31.658787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:31.664270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-24e2f008-e9e0-4c12-b089-18fa20981509 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.214060 Jan 25 03:40:31.665347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 470/864] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:31 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:31.984353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:31.984887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:31.990776 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:31.991275 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:31.992057 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:31.992499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:32.155371 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:32.164507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:32.166032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:32.167215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2625a738-453b-4763-9d7c-8186299df110 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.186694 Jan 25 03:40:32.167799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 395/865] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:31 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:32.335775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:32.336383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:32.342975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:32.343973 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:32.344224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:32.344716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:32.485931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:32.493825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1967f191-a732-4d86-8021-821fa168295c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.161635 Jan 25 03:40:32.494407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 471/866] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:32 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:32.789555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:32.800398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:32.800398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:32.800398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:32.800398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:32.800785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:32.935123 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:32.943179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-28769f28-9918-4faf-b048-5d0c60336b53 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.265164 Jan 25 03:40:32.943744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 396/867] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:32 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:33.187926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:33.188542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:33.196480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:33.196944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:33.197737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:33.198179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:33.339663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:33.349044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:33.351466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:33.351742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7d4badef-ed52-4c45-aacf-46153405662d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.167548 Jan 25 03:40:33.352294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 472/868] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:33 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:33.511402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:33.512592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:33.519952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:33.521420 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:33.521584 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:33.522126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:33.651546 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:33.658901 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-808042dc-db60-4fad-b68c-ffbc0add6767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.151279 Jan 25 03:40:33.659511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 397/869] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:33 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:33.960744 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:33.961288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:33.967170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:33.969755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:33.969755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:33.969755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:34.097615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:34.105105 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-35e25424-1988-4365-8de2-c86ae7ed8384 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.148160 Jan 25 03:40:34.105675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 473/870] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:33 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:34.369636 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:34.370238 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:34.376050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:34.377143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:34.377980 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:34.378432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:34.572149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:34.584902 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:34.586523 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:34.587967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5944c867-5e6f-4391-9b21-4cc8711e5eb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.222065 Jan 25 03:40:34.589041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 398/871] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:34 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:34.676196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:34.676812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:34.683025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:34.684958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:34.684958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:34.684958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:34.855894 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:34.867378 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8d6f57a5-6fe1-40df-8239-d94804b95352 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.195585 Jan 25 03:40:34.868197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 474/872] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:34 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:35.122707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:35.123859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:35.136971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:35.136971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:35.138210 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:35.138900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:35.369806 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:35.377826 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-52db15b9-7f9e-466c-aeb6-b4684ab65169 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.258959 Jan 25 03:40:35.378968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 399/873] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:35 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:35.605955 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:35.606573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:35.625035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:35.629012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:35.629012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:35.629012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:35.770728 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:35.779179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:35.780684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:35.784564 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-471f950c-0e7e-4277-ba46-e1a54ae6af71 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.179953 Jan 25 03:40:35.784564 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 475/874] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:35 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:35.884445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:35.885061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:35.891376 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:35.891829 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:35.892607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:35.893046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.019641 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:36.025330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:36.035869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.037353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.042921 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.045627 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.068777 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:36.076447 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:40:36.077529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4d52f0b8-3fff-4f6d-8d56-c99fb61372b9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.196741 Jan 25 03:40:36.078493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 400/875] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:35 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:36.397664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:36.397861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5864c136-0ccc-4876-b2dd-78354a12ff00 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "DELETE /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 204 len: 0 microversion: 2.1 time: 0.380968 Jan 25 03:40:36.397956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:36.398038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 476/876] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:40:36 2022] DELETE /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:40:36.404898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:36.406015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:36.406827 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.407339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.409494 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.409937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.417282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.424116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.424116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.424116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.562513 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:36.572126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9da27cd8-77d9-4378-a4cc-5500b1dd9c7b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1518 microversion: 2.1 time: 0.171071 Jan 25 03:40:36.573429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 477/877] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:36 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:36.606529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:36.616633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6d3ea298-6bf8-409f-9236-57a0f58ddedf tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1519 microversion: 2.1 time: 0.225702 Jan 25 03:40:36.617540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 401/878] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:36 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:36.783452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-f14328d8-f071-4cda-b08d-51fa3794a9d3 req-d8988050-1dd4-43a4-8e64-dfe0b39fe198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff", "name": "network-vif-deleted", "tag": "1c678aaa-9fbd-45b4-9a6f-9d3633b78121"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:36.783452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:40:36.783452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:40:36.797917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-f14328d8-f071-4cda-b08d-51fa3794a9d3 req-d8988050-1dd4-43a4-8e64-dfe0b39fe198 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.799039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-f14328d8-f071-4cda-b08d-51fa3794a9d3 req-d8988050-1dd4-43a4-8e64-dfe0b39fe198 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.800978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:36.801609 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:36.811576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.811576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.812203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:36.812641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:36.813210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-f14328d8-f071-4cda-b08d-51fa3794a9d3 req-d8988050-1dd4-43a4-8e64-dfe0b39fe198 service nova] Creating event network-vif-deleted:1c678aaa-9fbd-45b4-9a6f-9d3633b78121 for instance bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff on hv-cinder-81901 Jan 25 03:40:36.819008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-f14328d8-f071-4cda-b08d-51fa3794a9d3 req-d8988050-1dd4-43a4-8e64-dfe0b39fe198 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045664 Jan 25 03:40:36.820331 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 478/879] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:40:36.964937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:36.974401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:36.975906 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:36.977204 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ab4d56b9-b32e-4214-ad4d-fcba8cb01cfc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.180825 Jan 25 03:40:36.977796 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 402/880] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:36 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:37.097625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:37.098454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:37.105843 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:37.106452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:37.107302 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:37.107747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:37.269837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:37.277271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-58d2cc2a-e8b4-487d-93eb-d114fb2e3f25 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1279 microversion: 2.1 time: 0.184783 Jan 25 03:40:37.277835 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 479/881] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:37 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1279 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:37.589172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:37.589786 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:37.596020 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:37.596766 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:37.597763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:37.598207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:37.634801 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:37.636926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:37.644279 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:37.645707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:37.646869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:37.647823 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:37.711783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:37.711783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:37.711783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lazy-loading 'fault' on Instance uuid bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:37.747662 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:37.756561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b48bf9a1-fd85-486e-89f6-d3363458d066 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 200 len: 1312 microversion: 2.1 time: 0.126581 Jan 25 03:40:37.758757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 480/882] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:37 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:37.785637 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:37.793878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-44520081-b051-4a10-8f25-ed49637a7114 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1518 microversion: 2.1 time: 0.208285 Jan 25 03:40:37.794616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 403/883] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:37 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1518 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:37.995701 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:37.996643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:38.004731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.005195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:38.006094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.006535 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:38.180875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:38.189268 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:38.190779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:38.191969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0885ab08-af4f-40b5-9581-85f7d68f514f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.200573 Jan 25 03:40:38.192793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 481/884] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:37 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:38.294951 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:38.296144 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:38.303171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.303615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:38.304381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.304813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:38.460517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:38.467923 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1d57ebd9-5ddb-4864-99ec-8319e25440bb tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.176725 Jan 25 03:40:38.468490 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 404/885] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:38 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:38.777829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:38.778582 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:38.785301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.785756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:38.786543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.786997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:38.803628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] HTTP exception thrown: Instance bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff could not be found. Jan 25 03:40:38.804366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Returning 404 to user: Instance bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:40:38.805195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d0417c0c-510f-4368-8de0-b55ec6fcec37 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff" status: 404 len: 111 microversion: 2.1 time: 0.031642 Jan 25 03:40:38.808990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 482/886] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:38 2022] GET /compute/v2.1/servers/bd9dcc27-ba33-4bc9-b7a0-f3b1162807ff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:40:38.814971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:38.815493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:38.821729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.822172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:38.823170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:38.823607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:39.060738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:39.069043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-81d77b71-7d20-4e54-9371-d0374044c797 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1518 microversion: 2.1 time: 0.258661 Jan 25 03:40:39.069605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 405/887] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:38 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:39.209852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:39.210465 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:39.217097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:39.217554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:39.218337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:39.218776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:39.300930 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-35ac9a9f-788c-438f-a798-6662cbaae8aa req-a642a1d4-6d48-4aeb-a97b-85c1df38d4b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17671564-7d41-4c30-b928-409b5a40f3a7", "name": "network-vif-deleted", "tag": "2f6d88f6-f3ce-4d4e-b0c9-e5297f4479d9"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:39.302631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:40:39.302631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:40:39.311120 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-35ac9a9f-788c-438f-a798-6662cbaae8aa req-a642a1d4-6d48-4aeb-a97b-85c1df38d4b1 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:39.316023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-35ac9a9f-788c-438f-a798-6662cbaae8aa req-a642a1d4-6d48-4aeb-a97b-85c1df38d4b1 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:39.324036 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-35ac9a9f-788c-438f-a798-6662cbaae8aa req-a642a1d4-6d48-4aeb-a97b-85c1df38d4b1 service nova] Creating event network-vif-deleted:2f6d88f6-f3ce-4d4e-b0c9-e5297f4479d9 for instance 17671564-7d41-4c30-b928-409b5a40f3a7 on hv-cinder-81901 Jan 25 03:40:39.329182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-35ac9a9f-788c-438f-a798-6662cbaae8aa req-a642a1d4-6d48-4aeb-a97b-85c1df38d4b1 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032027 Jan 25 03:40:39.331130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 406/888] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:40:39.385630 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:39.394883 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:39.396667 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:39.402214 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c204bde3-692b-404c-91be-cd8343cfa3d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.191643 Jan 25 03:40:39.402214 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 483/889] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:39 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:39.485393 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:39.486599 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:39.492967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:39.493627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:39.496406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:39.496406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:39.641760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:39.650250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cb32f89b-917b-4289-85eb-d53217be0e4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.168842 Jan 25 03:40:39.659695 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 407/890] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:39 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:40.085574 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:40.086616 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:40.092482 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.092930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.094933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.095635 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.102715 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:40.103468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:40.109814 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.114159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.114159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.114159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.133729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.134184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.134637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lazy-loading 'fault' on Instance uuid 17671564-7d41-4c30-b928-409b5a40f3a7 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:40:40.144385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:40:40.192839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:40.211768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-35fd4d57-0480-43a9-804a-d75ba77cd069 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 200 len: 1313 microversion: 2.1 time: 0.125262 Jan 25 03:40:40.213927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 484/891] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:40 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 1313 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:40.417392 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:40.418117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:40.425827 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.434520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.434520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.434520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.435112 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8b18de0c-cb43-4e08-858c-492b65c42749 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 204 len: 0 microversion: 2.1 time: 0.334775 Jan 25 03:40:40.435573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 408/892] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:40:40 2022] DELETE /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 25 03:40:40.444711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:40.445851 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:40.451778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.452248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.453302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.460666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.634878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:40.644787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:40.646415 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:40.647872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0657c071-6e85-4164-a416-b484bc3c6764 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.234563 Jan 25 03:40:40.648891 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 485/893] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:40 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:40.666985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:40.667851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:40.675414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.675968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.676849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:40.677363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:40.831201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:40.839445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-983d9a97-19eb-4a1a-aa15-11d4ab1f74e3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.176013 Jan 25 03:40:40.846951 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 486/894] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:40 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:40.858478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:40.866875 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-35071950-507a-429d-b966-4fec2dce36d5 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1518 microversion: 2.1 time: 0.426952 Jan 25 03:40:40.867470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 409/895] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:40 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1518 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:41.229626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:41.230246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 17671564-7d41-4c30-b928-409b5a40f3a7] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:41.236442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:41.237025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:41.237879 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:41.238341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:41.252467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] HTTP exception thrown: Instance 17671564-7d41-4c30-b928-409b5a40f3a7 could not be found. Jan 25 03:40:41.253351 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Returning 404 to user: Instance 17671564-7d41-4c30-b928-409b5a40f3a7 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:40:41.254181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-305cd8b8-6738-4704-9057-7c2409884075 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7" status: 404 len: 111 microversion: 2.1 time: 0.028620 Jan 25 03:40:41.254893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 487/896] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:41 2022] GET /compute/v2.1/servers/17671564-7d41-4c30-b928-409b5a40f3a7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:40:41.856927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:41.857543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:41.871297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:41.871297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:41.871297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:41.871297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:41.899257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:41.900367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:41.919891 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:41.920480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:41.922543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:41.923331 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:42.089561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:42.100072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:42.102063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:42.103605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b765cc84-ed52-43b6-a014-01e69f2fa21b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.440841 Jan 25 03:40:42.104720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 410/897] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:41 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:42.116434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:42.117444 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:42.123742 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:42.124564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:42.125932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:42.127499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:42.171967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:42.180767 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9dee4d0b-cdb6-4c00-acb2-dc3fc916b7de tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.327847 Jan 25 03:40:42.181402 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 488/898] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:41 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:42.266667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:42.275665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4ebd13ee-55bf-4e8b-bbfa-737fe3262fd9 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1518 microversion: 2.1 time: 0.168736 Jan 25 03:40:42.276353 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 411/899] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:42 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:43.125139 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:43.126968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:43.134420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:43.134883 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:43.135783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:43.136230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:43.206234 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:43.208203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:43.215717 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:43.216300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:43.217404 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:43.218125 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:43.303985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:43.313203 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:43.315764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:43.317452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7ea28680-0dc2-4419-8140-bae5132ee2f7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.197109 Jan 25 03:40:43.318769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 489/900] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:43 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:43.330972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:43.332164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:43.339560 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:43.340269 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:43.341264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:43.342103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:43.383839 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:43.391502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-70d2ec42-23dc-4d96-8b4a-338eb027e76c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.189240 Jan 25 03:40:43.392958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 412/901] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:43 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:43.579493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:43.587708 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1fbb213b-c505-4739-bf02-4a09300d0d56 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1518 microversion: 2.1 time: 0.267616 Jan 25 03:40:43.588371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 490/902] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:43 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:44.337212 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:44.338572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:44.346015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:44.346566 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:44.347733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:44.348462 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:44.415427 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:44.416669 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:44.423922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:44.424380 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:44.425196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:44.425634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:44.535480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:44.546287 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:44.548704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:44.550192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7fb37bda-9cdf-40c4-bc06-8033dc8308a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.217106 Jan 25 03:40:44.557334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 413/903] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:44 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:44.604615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:44.605255 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:44.613257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:44.615362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:44.615362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:44.615709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:44.644909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:44.656431 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d8e4bfa1-447d-4cf6-8811-698bb9d3ab56 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.250931 Jan 25 03:40:44.658614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 491/904] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:44 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:44.779345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:44.788781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-29280458-ee84-430a-9582-e3b9da300c6a tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1518 microversion: 2.1 time: 0.187789 Jan 25 03:40:44.789351 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 414/905] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:44 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:45.569624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:45.570229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:45.576964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:45.577618 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:45.578436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:45.578871 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:45.674440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:45.675676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:45.683628 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:45.683779 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:45.684448 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:45.684883 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:45.749668 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:45.755434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:45.757612 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:45.758795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-29f9702c-1d5a-4962-882f-64d17d2224fc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.193126 Jan 25 03:40:45.769303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 492/906] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:45 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:45.805919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:45.806543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:45.812875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:45.813325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:45.814372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:45.814876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:45.843266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:45.852260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d16b9b7f-d99b-42c7-a5b8-5bba8b984b5e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.182268 Jan 25 03:40:45.853317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 415/907] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:45 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:45.963413 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:45.973269 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8c57d512-c8dc-465a-a708-5ddd28fa5734 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1518 microversion: 2.1 time: 0.171275 Jan 25 03:40:45.973759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 493/908] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:45 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:46.776794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:46.778321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:46.807138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:46.808834 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:46.813248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:46.814495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:46.880925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:46.883379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:46.903939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:46.904637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:46.905599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:46.906199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:47.130842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:47.140834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9d4d3297-955c-474f-b7fe-0a0f1b063b7a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.264231 Jan 25 03:40:47.144747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 494/909] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:46 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:47.153624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:47.157062 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:47.168291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:47.168756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:47.173689 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:47.174548 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:47.184813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:47.194511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:47.196075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:47.197269 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d537c1cb-9786-424e-83db-5fb9a9c94be8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.424346 Jan 25 03:40:47.201141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 416/910] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:46 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:47.207919 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-0f2f7eb4-593c-47ba-b686-ddff564f0789 req-e20d846a-7f7e-4d36-84fa-6f8531a13d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83cc2c8-a438-49f9-b79c-e74359899f65", "name": "network-vif-deleted", "tag": "565ed7d6-bff7-4ce1-97e7-071173dbd857"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:47.209509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:40:47.209509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:40:47.220758 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-0f2f7eb4-593c-47ba-b686-ddff564f0789 req-e20d846a-7f7e-4d36-84fa-6f8531a13d3e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:47.221412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-0f2f7eb4-593c-47ba-b686-ddff564f0789 req-e20d846a-7f7e-4d36-84fa-6f8531a13d3e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:47.232651 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-0f2f7eb4-593c-47ba-b686-ddff564f0789 req-e20d846a-7f7e-4d36-84fa-6f8531a13d3e service nova] Creating event network-vif-deleted:565ed7d6-bff7-4ce1-97e7-071173dbd857 for instance b83cc2c8-a438-49f9-b79c-e74359899f65 on hv-cinder-81901 Jan 25 03:40:47.238350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-0f2f7eb4-593c-47ba-b686-ddff564f0789 req-e20d846a-7f7e-4d36-84fa-6f8531a13d3e service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036055 Jan 25 03:40:47.239342 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 417/911] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:40:47.263173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a4cd3a6bc441d8b1d4bfdd15a6402d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e67c9d0a7f44900a2ac9fdc1bdcb15a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:47.276253 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d22f9550-f13e-4996-bd47-077ff9bd6334 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 200 len: 1476 microversion: 2.1 time: 0.130132 Jan 25 03:40:47.277068 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 495/912] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:47 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 1476 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:48.166094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:48.166094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:48.172800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:48.174265 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:48.175394 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:48.176061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:48.220458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:48.223943 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:48.234274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:48.239460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:48.240988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:48.252374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:48.463587 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:48.476067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fc440298-d9fe-49d4-89e8-87133b29f4f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.314775 Jan 25 03:40:48.487741 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 418/913] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:48 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:48.492838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:48.493679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] [instance: b83cc2c8-a438-49f9-b79c-e74359899f65] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:48.503183 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:48.503892 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:48.504900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:48.505605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:48.526633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] HTTP exception thrown: Instance b83cc2c8-a438-49f9-b79c-e74359899f65 could not be found. Jan 25 03:40:48.527565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] Returning 404 to user: Instance b83cc2c8-a438-49f9-b79c-e74359899f65 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:40:48.529841 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5bf9816f-936d-4deb-a206-eb37b6d78cd4 tempest-AttachVolumeNegativeTest-677348741 tempest-AttachVolumeNegativeTest-677348741-project] 10.222.0.115 "GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65" status: 404 len: 111 microversion: 2.1 time: 0.040731 Jan 25 03:40:48.531329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 419/914] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:48 2022] GET /compute/v2.1/servers/b83cc2c8-a438-49f9-b79c-e74359899f65 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:40:48.570231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:48.580434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:48.581934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:48.583349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-92a21b3c-c155-4b15-8852-60ddfcbbb482 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.367715 Jan 25 03:40:48.584067 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 496/915] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:48 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:48.725298 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-c3e0dcc1-70e9-4110-9488-78dcc12a576f req-93a64fb0-8918-4350-855a-d7e0d014bf15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c1179f-67c0-4198-8933-7cabe5c964f3", "name": "network-vif-plugged", "status": "completed", "tag": "23790178-4f79-4bcf-a17f-bd8e5abf0427"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:48.727159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:40:48.727159 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:40:48.742026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-c3e0dcc1-70e9-4110-9488-78dcc12a576f req-93a64fb0-8918-4350-855a-d7e0d014bf15 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:48.742705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-c3e0dcc1-70e9-4110-9488-78dcc12a576f req-93a64fb0-8918-4350-855a-d7e0d014bf15 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:48.770190 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-c3e0dcc1-70e9-4110-9488-78dcc12a576f req-93a64fb0-8918-4350-855a-d7e0d014bf15 service nova] Creating event network-vif-plugged:23790178-4f79-4bcf-a17f-bd8e5abf0427 for instance b5c1179f-67c0-4198-8933-7cabe5c964f3 on hv-cinder-81901 Jan 25 03:40:48.785889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-c3e0dcc1-70e9-4110-9488-78dcc12a576f req-93a64fb0-8918-4350-855a-d7e0d014bf15 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063748 Jan 25 03:40:48.786511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 420/916] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:40:49.496170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:49.496808 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:49.504304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:49.504699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:49.505500 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:49.505934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:49.603975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:49.604686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:49.613904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:49.614318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:49.615356 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:49.619364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:49.706389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:49.714743 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4603fe5f-30df-403e-9be2-1f5b2400fd9e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.224838 Jan 25 03:40:49.715363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 497/917] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:49 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:49.939002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:49.954784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:49.956440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:49.957756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-71d1d417-d682-4aa5-b54e-106888bd0f33 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.359367 Jan 25 03:40:49.958381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 421/918] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:49 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:50.737522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:50.741673 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:50.753968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:50.755346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:50.757343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:50.758711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:50.977859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:50.979627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:50.990729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:50.993036 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:50.993853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:50.994290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:51.154628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:51.167868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-45839aa7-d637-48de-9161-eed1b64854e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.439368 Jan 25 03:40:51.168464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 498/919] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:50 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:51.225114 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:51.238396 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:51.240203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:51.241750 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2b197b74-8110-4ad3-8282-1d147c19a210 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.267763 Jan 25 03:40:51.243012 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 422/920] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:50 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:40:52.186022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:52.189335 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:52.197571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:52.198039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:52.201430 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:52.201430 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:52.263379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:52.267710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:52.278830 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:52.279329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:52.280191 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:52.281003 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:52.456410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:52.463766 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7852c941-513e-4f0b-aaf4-974beb5f1fa3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.282421 Jan 25 03:40:52.464064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:52.486911 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:52.487111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 499/921] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:52 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:52.487208 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:52.487208 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1e189379-d97e-4b15-b6c5-fbd561f8647c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.220304 Jan 25 03:40:52.487208 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 423/922] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:52 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:53.346562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-621e44db-379c-4b11-8313-3cd5fda469d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Action: 'create', calling method: .version_select at 0x7f33a849cdc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-698612597"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:53.363904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-621e44db-379c-4b11-8313-3cd5fda469d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Getting quotas for project 5820f90cd1d1413e9885c9ec8005f384. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:40:53.372156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-621e44db-379c-4b11-8313-3cd5fda469d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Getting quotas for user 895b57e29c85419eaae67144c0da86ec and project 5820f90cd1d1413e9885c9ec8005f384. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:40:53.494568 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:53.495809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:53.506457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:53.507181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:53.515214 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:53.515214 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:53.633979 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-621e44db-379c-4b11-8313-3cd5fda469d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Getting quotas for project 5820f90cd1d1413e9885c9ec8005f384. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:40:53.637898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-621e44db-379c-4b11-8313-3cd5fda469d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Getting quotas for user 895b57e29c85419eaae67144c0da86ec and project 5820f90cd1d1413e9885c9ec8005f384. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:40:53.662025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-621e44db-379c-4b11-8313-3cd5fda469d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.507919 Jan 25 03:40:53.662622 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 500/923] 10.222.0.115 () {60 vars in 1162 bytes} [Tue Jan 25 03:40:53 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:53.683826 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:53.684477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:53.698731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:53.701414 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:53.702457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:53.703132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:53.824808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:53.839640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a14c7048-4ebf-43ad-841c-4d96be19e9a8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.350195 Jan 25 03:40:53.840335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 424/924] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:53 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:53.970691 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:53.979114 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:53.980826 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:53.982083 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8a672828-1ab6-4e17-ab07-4424943e62d4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.318099 Jan 25 03:40:53.985282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 501/925] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:53 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:54.183587 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1834441955", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "networks": [{"uuid": "53c1fc18-89c3-459d-a1e2-14cd4e6b342a"}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:54.232513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] validate_networks() for [('53c1fc18-89c3-459d-a1e2-14cd4e6b342a', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:40:54.668862 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:40:54.669367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:40:54.669738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:40:54.670143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:40:54.670549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:40:54.679896 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:54.680343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:54.681148 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:54.681581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:54.698221 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Getting quotas for project 669e86b55a1248009baefdb84c00453a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:40:54.702100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Getting quotas for user b59b37fe3f1244fe8be12a62c33f55e9 and project 669e86b55a1248009baefdb84c00453a. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:40:54.713653 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:40:54.716005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:40:54.857572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:54.858374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:54.866858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e4d348e9-76e0-4647-8347-1b9fb7ad6d8e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.686972 Jan 25 03:40:54.867327 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:54.868026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:54.868523 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 425/926] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:40:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:40:54.869522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:54.870126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:54.880804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-888166b1-ff12-48e4-8fbc-300feb71d8f1 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:54.881683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-888166b1-ff12-48e4-8fbc-300feb71d8f1 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:54.965434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-888166b1-ff12-48e4-8fbc-300feb71d8f1 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:54.973782 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-888166b1-ff12-48e4-8fbc-300feb71d8f1 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1223 microversion: 2.1 time: 0.099781 Jan 25 03:40:54.974367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 426/927] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:54 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:40:55.001372 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:55.003825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:55.015607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:55.016240 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:55.017695 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:55.018131 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:55.301450 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:55.313672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b9627cc5-7c9b-44b3-bafd-1f3be6846f1b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.459422 Jan 25 03:40:55.323733 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 502/928] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:54 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:55.357033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:55.387486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:55.389583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:55.396363 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1acc9728-f9cd-4e05-bce9-1834cd2598eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.398327 Jan 25 03:40:55.398417 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 427/929] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:54 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:55.455901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-bf22def9-6dee-45d5-ad86-e118dcce182a req-48599a9f-1e2c-4e02-bf49-9d848c6c060f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7ea524-7a77-478b-9894-556c2be34d87", "name": "network-vif-plugged", "status": "completed", "tag": "185f7b43-0027-48fd-9809-01daf6b8ce49"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:40:55.460415 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:40:55.460415 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:40:55.477230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-bf22def9-6dee-45d5-ad86-e118dcce182a req-48599a9f-1e2c-4e02-bf49-9d848c6c060f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:55.478025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-bf22def9-6dee-45d5-ad86-e118dcce182a req-48599a9f-1e2c-4e02-bf49-9d848c6c060f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:55.492458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-bf22def9-6dee-45d5-ad86-e118dcce182a req-48599a9f-1e2c-4e02-bf49-9d848c6c060f service nova] Creating event network-vif-plugged:185f7b43-0027-48fd-9809-01daf6b8ce49 for instance ac7ea524-7a77-478b-9894-556c2be34d87 on hv-cinder-81901 Jan 25 03:40:55.499809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-bf22def9-6dee-45d5-ad86-e118dcce182a req-48599a9f-1e2c-4e02-bf49-9d848c6c060f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056913 Jan 25 03:40:55.500919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 503/930] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:40:55.990616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f9d94714-f0f4-4938-b09d-2b75aca5ff72 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:55.991485 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f9d94714-f0f4-4938-b09d-2b75aca5ff72 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:56.046923 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f9d94714-f0f4-4938-b09d-2b75aca5ff72 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:56.053777 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f9d94714-f0f4-4938-b09d-2b75aca5ff72 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1223 microversion: 2.1 time: 0.067239 Jan 25 03:40:56.054346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 428/931] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:55 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1223 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:56.332607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:56.339332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:56.339952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:56.340415 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:56.341212 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:56.341661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:56.416410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:56.417250 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:56.427075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:56.427811 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:56.430392 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:56.437627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:56.579992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:56.592227 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:56.592562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ae79c909-690c-487e-b78a-16343c781cc3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.265005 Jan 25 03:40:56.593650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 504/932] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:56 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:56.608918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:56.611728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:56.615664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-37f5ac5f-7a9b-4231-9342-371aebc4e4d2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1812 microversion: 2.20 time: 0.200605 Jan 25 03:40:56.615664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 429/933] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:56 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1812 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:57.070928 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:57.071847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:57.077957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:57.078599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:57.080321 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:57.080875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:57.163706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:57.171771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-06feb481-8289-44c3-ac44-58d4b9a8d2f9 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1219 microversion: 2.1 time: 0.104911 Jan 25 03:40:57.172352 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 505/934] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:57 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:57.610964 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:57.612150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:57.634606 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:57.635260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:57.643392 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:57.644075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:57.644936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:57.645378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:57.655165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:57.655634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:57.656448 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:57.660568 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:57.859166 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:57.860233 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:57.869072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:57.883246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:57.883246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0d01a362-7225-41bf-aa04-bbf017c22bd1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1799 microversion: 2.20 time: 0.243376 Jan 25 03:40:57.883246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 506/935] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:40:57 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1799 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:40:57.883673 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9ecb0f5a-3b25-4f29-a26c-46c330ce935d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1267 microversion: 2.1 time: 0.268331 Jan 25 03:40:57.883673 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 430/936] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:57 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:58.201429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:58.204667 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:58.214941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:58.215433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:58.216229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:58.216672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:58.335498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:58.344097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bca7cc94-54ed-4a0d-b2e8-50ec581e67fe tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1283 microversion: 2.1 time: 0.153805 Jan 25 03:40:58.345898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 507/937] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:58 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:58.892303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:58.892936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:58.899822 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:58.900567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:58.901401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:58.902147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:59.084644 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:59.093598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fdf927c8-444c-454c-b768-403bed0e5c52 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1454 microversion: 2.1 time: 0.205343 Jan 25 03:40:59.094565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 431/938] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:58 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:59.112272 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:59.113162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:59.129683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:59.135222 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:59.135222 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:59.135222 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:59.375320 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:40:59.377369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:40:59.387228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:59.388026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:59.388949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:40:59.389498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:40:59.601462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:59.610915 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9b009ab6-c75e-4bd2-a2c5-66a919ccc887 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1454 microversion: 2.1 time: 0.502874 Jan 25 03:40:59.611919 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 508/939] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:59 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1454 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:40:59.824415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:40:59.836502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2f92be90-1dff-4151-a922-fef2f84cae3b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.474420 Jan 25 03:40:59.842142 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 432/940] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:40:59 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:41:00.413350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-59fa56cb-8388-4ee4-8ca6-e864da3c5373 req-83a05629-e4d5-4d91-8dc1-6a91fe5dc0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11f511b5-f452-4aac-bfac-67d6c8ccfade", "tag": "df320267-a729-47d9-999d-84e49eb217bd"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:00.415133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:41:00.415133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:41:00.422417 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-59fa56cb-8388-4ee4-8ca6-e864da3c5373 req-83a05629-e4d5-4d91-8dc1-6a91fe5dc0bb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:00.422967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-59fa56cb-8388-4ee4-8ca6-e864da3c5373 req-83a05629-e4d5-4d91-8dc1-6a91fe5dc0bb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:00.434338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-59fa56cb-8388-4ee4-8ca6-e864da3c5373 req-83a05629-e4d5-4d91-8dc1-6a91fe5dc0bb service nova] Creating event network-changed:df320267-a729-47d9-999d-84e49eb217bd for instance 11f511b5-f452-4aac-bfac-67d6c8ccfade on hv-cinder-81901 Jan 25 03:41:00.439319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-59fa56cb-8388-4ee4-8ca6-e864da3c5373 req-83a05629-e4d5-4d91-8dc1-6a91fe5dc0bb service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029543 Jan 25 03:41:00.440269 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 509/941] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:41:00.857232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:00.857232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:00.864210 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:00.864674 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:00.865521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:00.865960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:01.169610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:01.177287 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c33d6f45-cb79-4d14-a9ce-87fed870bd05 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.324668 Jan 25 03:41:01.177857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 433/942] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:00 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:02.148152 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-17ca83db-2ab5-450a-883a-84a4a59488a8 req-f62f34e1-d197-4a7a-a60f-97927401751c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac7ea524-7a77-478b-9894-556c2be34d87", "tag": "185f7b43-0027-48fd-9809-01daf6b8ce49"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:02.149799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:41:02.149799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:41:02.158720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-17ca83db-2ab5-450a-883a-84a4a59488a8 req-f62f34e1-d197-4a7a-a60f-97927401751c service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:02.159304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-17ca83db-2ab5-450a-883a-84a4a59488a8 req-f62f34e1-d197-4a7a-a60f-97927401751c service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:02.170960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-17ca83db-2ab5-450a-883a-84a4a59488a8 req-f62f34e1-d197-4a7a-a60f-97927401751c service nova] Creating event network-changed:185f7b43-0027-48fd-9809-01daf6b8ce49 for instance ac7ea524-7a77-478b-9894-556c2be34d87 on hv-cinder-81901 Jan 25 03:41:02.177209 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-17ca83db-2ab5-450a-883a-84a4a59488a8 req-f62f34e1-d197-4a7a-a60f-97927401751c service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090318 Jan 25 03:41:02.177818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 510/943] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:41:02.194038 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:02.194679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:02.201033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:02.201484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:02.202271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:02.202703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:02.458033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:02.468196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8883adfb-bc40-49c1-a096-dc2a9e035d62 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.278074 Jan 25 03:41:02.470087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 434/944] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:02 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:03.487539 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:03.488367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:03.496054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:03.496634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:03.497655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:03.498201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:03.638918 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:03.648271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0eff99c3-9cd3-4dbe-b4e6-445e5d08f56b tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.166145 Jan 25 03:41:03.648862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 511/945] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:03 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:04.665701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:04.666403 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:04.673249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:04.673818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:04.675001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:04.675549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:04.811478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:04.819116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-86efcf59-d58d-449d-bf5a-935b4e6c430c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.157240 Jan 25 03:41:04.819698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 435/946] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:04 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:05.836110 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:05.836719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:05.843092 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:05.843560 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:05.844343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:05.844788 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:05.978646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:05.985758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-721722df-1358-44a0-a105-f65568f04f19 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.153332 Jan 25 03:41:05.986587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 512/947] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:05 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:07.002605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:07.003262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:07.009737 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:07.010190 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:07.011017 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:07.011619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:07.154833 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:07.164657 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-46223d40-b22c-4132-a4ee-931b77061716 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.166619 Jan 25 03:41:07.165228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 436/948] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:06 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:08.181461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:08.182118 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:08.188399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:08.188848 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:08.190498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:08.191002 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:08.320440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:08.327645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-748b55a5-3cd7-4582-8638-4c079959e477 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.149873 Jan 25 03:41:08.328207 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 513/949] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:08 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:09.176190 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-4baca7ca-157a-4740-a567-b3336f2bcb25 req-41601b89-2def-405c-b3b8-6f6213319110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f511b5-f452-4aac-bfac-67d6c8ccfade", "name": "network-vif-plugged", "status": "completed", "tag": "df320267-a729-47d9-999d-84e49eb217bd"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:09.177884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:41:09.177884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:41:09.185272 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4baca7ca-157a-4740-a567-b3336f2bcb25 req-41601b89-2def-405c-b3b8-6f6213319110 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:09.188593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4baca7ca-157a-4740-a567-b3336f2bcb25 req-41601b89-2def-405c-b3b8-6f6213319110 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:09.196754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-4baca7ca-157a-4740-a567-b3336f2bcb25 req-41601b89-2def-405c-b3b8-6f6213319110 service nova] Creating event network-vif-plugged:df320267-a729-47d9-999d-84e49eb217bd for instance 11f511b5-f452-4aac-bfac-67d6c8ccfade on hv-cinder-81901 Jan 25 03:41:09.201643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-4baca7ca-157a-4740-a567-b3336f2bcb25 req-41601b89-2def-405c-b3b8-6f6213319110 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030041 Jan 25 03:41:09.202225 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 437/950] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:41:09.345052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:09.345666 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:09.352672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:09.353176 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:09.354113 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:09.354390 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:09.486974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:09.494303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-77f95bf5-a276-4d46-a5ef-e6c2e1bca246 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.153171 Jan 25 03:41:09.494870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 514/951] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:09 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:10.513581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:10.514343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:10.525912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:10.525912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:10.525912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:10.525912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:10.651856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:10.659586 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4c12b3fe-347d-4ee2-9b3a-0dd630808b63 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1323 microversion: 2.1 time: 0.151632 Jan 25 03:41:10.660152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 438/952] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:10 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:11.676754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:11.677402 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:11.683796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:11.688341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:11.688341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:11.688341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:11.823001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:11.830277 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-37fa5e7c-866a-491c-801a-22f4517e29e6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1513 microversion: 2.1 time: 0.157432 Jan 25 03:41:11.831010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 515/953] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:11 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:11.846943 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a3e62877-38b1-4f95-a6e9-583541c79fbb tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6373933-39ac-4dd3-b313-805723507c81", "device": "/dev/sdb"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:11.851898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a3e62877-38b1-4f95-a6e9-583541c79fbb tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:11.854207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3e62877-38b1-4f95-a6e9-583541c79fbb tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:11.854655 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3e62877-38b1-4f95-a6e9-583541c79fbb tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:11.855454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3e62877-38b1-4f95-a6e9-583541c79fbb tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:11.855887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3e62877-38b1-4f95-a6e9-583541c79fbb tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:12.584060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a3e62877-38b1-4f95-a6e9-583541c79fbb tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "POST /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741335 Jan 25 03:41:12.584667 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 439/954] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:41:11 2022] POST /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:41:21.847589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2033245741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-698612597", "security_groups": [{"name": "tempest-secgroup-smoke-1709121335"}], "networks": [{"uuid": "8ee0ecc3-8cb9-4185-b3bc-522f9bcc45e0"}], "block_device_mapping_v2": [{"uuid": "39281ecf-35c8-4646-b629-bcb8179e7bcb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:21.958164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] validate_networks() for [('8ee0ecc3-8cb9-4185-b3bc-522f9bcc45e0', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:41:22.515992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:41:22.516422 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:41:22.516916 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:41:22.517332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:41:22.517754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:41:22.527594 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:22.528056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:22.528871 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:22.529308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:22.545828 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Getting quotas for project 5820f90cd1d1413e9885c9ec8005f384. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:41:22.549781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Getting quotas for user 895b57e29c85419eaae67144c0da86ec and project 5820f90cd1d1413e9885c9ec8005f384. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:41:22.607792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:41:22.610264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39281ecf-35c8-4646-b629-bcb8179e7bcb',volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:41:23.073347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-09ab54bd-9aaf-445d-b008-5b7a172f42d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.229359 Jan 25 03:41:23.074145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 516/955] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:41:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:41:23.085714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f92e8ba9-d5eb-4aba-842b-70bcb1a8ef4e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:23.086421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f92e8ba9-d5eb-4aba-842b-70bcb1a8ef4e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:23.139266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f92e8ba9-d5eb-4aba-842b-70bcb1a8ef4e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:23.146432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f92e8ba9-d5eb-4aba-842b-70bcb1a8ef4e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1091 microversion: 2.1 time: 0.065281 Jan 25 03:41:23.147450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 440/956] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:23 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1091 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:24.164579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:24.165201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:24.172024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:24.172476 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:24.173466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:24.173910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:24.243591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:24.250711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-26584fde-7b64-4c4e-a6d8-7bd07f93793f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1141 microversion: 2.1 time: 0.090821 Jan 25 03:41:24.251293 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 517/957] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:24 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1141 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:25.267391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:25.268008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:25.275861 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:25.276310 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:25.277089 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:25.277529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:25.335329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:25.342563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-20dab67d-3688-4518-b583-7db1b9af48e5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1141 microversion: 2.1 time: 0.078839 Jan 25 03:41:25.343402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 441/958] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:25 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1141 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:26.359276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:26.359892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:26.366961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:26.367438 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:26.368283 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:26.368723 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:26.441456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:26.448828 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-cf755bc5-1943-4176-8796-c9f5c1780f7c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1141 microversion: 2.1 time: 0.093302 Jan 25 03:41:26.449434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 518/959] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:26 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1141 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:27.465412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:27.466031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:27.472462 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:27.472925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:27.473788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:27.474238 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:27.542448 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:27.550030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-54c2fb41-4ae0-44ad-b8bc-64a89324e17d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1141 microversion: 2.1 time: 0.088198 Jan 25 03:41:27.550605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 442/960] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:27 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1141 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:28.566645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:28.567191 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:28.574230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:28.574685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:28.576090 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:28.576090 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:28.635238 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:28.649912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c5d3277d-0269-4c8d-8f67-b609e45f000e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1197 microversion: 2.1 time: 0.085177 Jan 25 03:41:28.654470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 519/961] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:28 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:29.671033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:29.671577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:29.678412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:29.679424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:29.679650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:29.680084 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:29.892426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:29.900026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c0021cf1-1ef7-405e-9a04-01a6055736ad tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.232791 Jan 25 03:41:29.900614 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 443/962] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:29 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:30.423938 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-4b064361-7edd-4ca7-bbc9-2a8d0c05c422 req-a4af7fb8-0101-487d-948a-b2e16e7d55d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d", "tag": "b93b0fe2-4ab5-4c3c-81e5-39ac08ded566"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:30.425579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:41:30.425579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:41:30.433164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-4b064361-7edd-4ca7-bbc9-2a8d0c05c422 req-a4af7fb8-0101-487d-948a-b2e16e7d55d4 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:30.433764 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-4b064361-7edd-4ca7-bbc9-2a8d0c05c422 req-a4af7fb8-0101-487d-948a-b2e16e7d55d4 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:30.445533 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-4b064361-7edd-4ca7-bbc9-2a8d0c05c422 req-a4af7fb8-0101-487d-948a-b2e16e7d55d4 service nova] Creating event network-changed:b93b0fe2-4ab5-4c3c-81e5-39ac08ded566 for instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d on hv-cinder-81901 Jan 25 03:41:30.451344 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-4b064361-7edd-4ca7-bbc9-2a8d0c05c422 req-a4af7fb8-0101-487d-948a-b2e16e7d55d4 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169349 Jan 25 03:41:30.451969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 520/963] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:41:30.917176 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:30.917826 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:30.924418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:30.924771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:30.925558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:30.925996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:31.060709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:31.068958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-16202b17-dec4-4431-9527-8e7316dd4644 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.155603 Jan 25 03:41:31.069529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 444/964] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:30 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:32.089158 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:32.089776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:32.095939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:32.096398 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:32.097188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:32.097633 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:32.230066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:32.237202 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-71e9a3bd-bc33-422e-961c-7a6045a8f766 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.154902 Jan 25 03:41:32.237783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 521/965] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:32 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:33.253274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:33.253882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:33.261033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:33.261478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:33.262245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:33.262677 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:33.391267 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:33.398645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-085b7401-f020-474a-8e22-ae1dece72ae2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.148956 Jan 25 03:41:33.399246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 445/966] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:33 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:34.416210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:34.416868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:34.423232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:34.423684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:34.424457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:34.424896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:34.554996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:34.562415 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d28e6e13-6a11-4006-9289-ed740ccaaa2b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.149918 Jan 25 03:41:34.562981 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 522/967] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:34 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:35.580111 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:35.580761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:35.587722 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:35.588247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:35.589096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:35.589543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:35.717772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:35.726066 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-18aa9754-fe12-4791-b453-7b0e9d6ffad5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.149678 Jan 25 03:41:35.728978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 446/968] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:35 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:36.747315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:36.747978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:36.754480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:36.755130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:36.755929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:36.756454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:36.898598 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:36.905807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d9461684-dcd8-4832-85d8-010656c7aaff tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.163784 Jan 25 03:41:36.906376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 523/969] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:36 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:37.922695 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:37.923331 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:37.930292 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:37.930738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:37.931537 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:37.931965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:38.064711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:38.072274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-84d7517e-1b65-438f-a014-c618fbfb2fd8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.153363 Jan 25 03:41:38.072844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 447/970] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:37 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:39.089048 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:39.089810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:39.096215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:39.096671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:39.097451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:39.097893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:39.224678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:39.232025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4df66113-de91-4280-9cce-c65e6e7989fc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.147257 Jan 25 03:41:39.232591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 524/971] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:39 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:40.248642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:40.249187 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:40.255464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:40.255920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:40.256694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:40.257265 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:40.391241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:40.398800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-723bae0d-3cfa-4d44-959f-b65e34fcb0f6 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1275 microversion: 2.1 time: 0.153836 Jan 25 03:41:40.401699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 448/972] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:40 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:41.415806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:41.416451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:41.429451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:41.429904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:41.431495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:41.431983 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:41.572127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:41.579458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-112d505e-912d-474b-9a3d-0c3d5868b35c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.167840 Jan 25 03:41:41.580040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 525/973] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:41 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:42.596299 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:42.596907 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:42.603811 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:42.604278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:42.605063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:42.605502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:42.734952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:42.742346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-368cc236-becf-41bc-8e70-12b8a94e0366 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.149686 Jan 25 03:41:42.742920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 449/974] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:42 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:42.795709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:42.797442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:42.802480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:42.802931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:42.803737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:42.804170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:42.881270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lazy-loading 'services' on Instance uuid 11f511b5-f452-4aac-bfac-67d6c8ccfade {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:41:43.118085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3855bf6e-3e30-413a-a7bf-1d840067cc87 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "DELETE /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade/os-volume_attachments/c6373933-39ac-4dd3-b313-805723507c81" status: 202 len: 0 microversion: 2.1 time: 0.325963 Jan 25 03:41:43.126852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 526/975] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:41:42 2022] DELETE /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade/os-volume_attachments/c6373933-39ac-4dd3-b313-805723507c81 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:41:43.765853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:43.766464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:43.772921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:43.773369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:43.774152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:43.774624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:43.914762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:43.923712 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-decc0e34-8977-42c2-b0f3-ed14c00a7314 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.161563 Jan 25 03:41:43.924357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 450/976] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:43 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:44.950450 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:44.952456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:44.960636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:44.960636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:44.960636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:44.961040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:45.095602 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:45.103350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6124b07f-f259-43b3-97ea-37d9065273fd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.157061 Jan 25 03:41:45.104119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 527/977] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:44 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:41:45.277576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:45.278116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:45.284427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:45.284883 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:45.285666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:45.286102 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:45.311978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:41:45.598530 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-59b82fa1-68a2-4957-b2cf-9d4b60bcfcf6 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "DELETE /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 204 len: 0 microversion: 2.1 time: 0.325111 Jan 25 03:41:45.599157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 451/978] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:41:45 2022] DELETE /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:41:45.607123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:45.607929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:45.613831 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:45.614288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:45.615322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:45.615768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:45.747954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:45.755384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-397169b6-1ca2-4982-ac4e-35f99e5393d7 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1519 microversion: 2.1 time: 0.151846 Jan 25 03:41:45.755960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 528/979] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:45 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:46.120833 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:46.121555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:46.127766 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:46.128281 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:46.129152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:46.129672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:46.341073 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:46.344304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1325a31d-1979-467b-b155-b1cbfc842eae tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.227857 Jan 25 03:41:46.345013 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 452/980] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:46 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:46.777646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:46.777646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:46.785382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:46.786021 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:46.786839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:46.787376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:46.938926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:46.951247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1b358bf5-1a80-46fa-b304-763d47abf64c tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1519 microversion: 2.1 time: 0.181548 Jan 25 03:41:46.951836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 529/981] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:46 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:41:47.367616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:47.369625 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:47.376517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:47.377355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:47.378403 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:47.378926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:47.959768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:47.967866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-833ab616-f0d2-4af4-9186-2d5932f373d9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.609746 Jan 25 03:41:47.968444 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 453/982] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:47 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:47.969470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:47.970084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:47.977472 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:47.978017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:47.978863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:47.979566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:48.119999 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:48.129111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fa22678d-6f4e-4179-bdb8-1baeaac02267 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1519 microversion: 2.1 time: 0.163518 Jan 25 03:41:48.130224 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 530/983] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:47 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:41:48.822061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-730f92bf-59db-4442-91a1-162570f6b861 req-2f0f6357-8c6a-490b-8b0c-c74f269b4772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11f511b5-f452-4aac-bfac-67d6c8ccfade", "name": "network-vif-deleted", "tag": "df320267-a729-47d9-999d-84e49eb217bd"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:48.825714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:41:48.825714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:41:48.844765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-730f92bf-59db-4442-91a1-162570f6b861 req-2f0f6357-8c6a-490b-8b0c-c74f269b4772 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:48.845511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-730f92bf-59db-4442-91a1-162570f6b861 req-2f0f6357-8c6a-490b-8b0c-c74f269b4772 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:48.858773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-730f92bf-59db-4442-91a1-162570f6b861 req-2f0f6357-8c6a-490b-8b0c-c74f269b4772 service nova] Creating event network-vif-deleted:df320267-a729-47d9-999d-84e49eb217bd for instance 11f511b5-f452-4aac-bfac-67d6c8ccfade on hv-cinder-81901 Jan 25 03:41:48.864902 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-730f92bf-59db-4442-91a1-162570f6b861 req-2f0f6357-8c6a-490b-8b0c-c74f269b4772 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047024 Jan 25 03:41:48.866394 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 454/984] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:41:48.985227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:48.985880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:48.996270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:48.998913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:49.000119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:49.002210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:49.147322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:49.148744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:49.157311 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:49.158156 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:49.159653 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:49.160348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:49.213678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:49.213947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:49.214288 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lazy-loading 'fault' on Instance uuid 11f511b5-f452-4aac-bfac-67d6c8ccfade {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:41:49.262652 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b37fe3f1244fe8be12a62c33f55e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669e86b55a1248009baefdb84c00453a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:49.272834 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6e90bd4f-2f67-40d5-aa52-74952a97a71e tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 200 len: 1313 microversion: 2.1 time: 0.130692 Jan 25 03:41:49.273458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:49.279461 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 455/985] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:49 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:41:49.283523 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1b55824d-5bbf-43b3-a5eb-30cbc2202306 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.302071 Jan 25 03:41:49.286389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 531/986] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:48 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:50.322979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:50.329930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:50.335355 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:50.336854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] [instance: 11f511b5-f452-4aac-bfac-67d6c8ccfade] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:50.351013 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:50.355311 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:50.355724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:50.356396 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:50.357274 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:50.357955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:50.358252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:50.361775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:50.391171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] HTTP exception thrown: Instance 11f511b5-f452-4aac-bfac-67d6c8ccfade could not be found. Jan 25 03:41:50.392001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] Returning 404 to user: Instance 11f511b5-f452-4aac-bfac-67d6c8ccfade could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:41:50.393656 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6b0a1472-d1ba-4de8-9bb8-7db8671d4cb3 tempest-VolumesSnapshotTestJSON-560759575 tempest-VolumesSnapshotTestJSON-560759575-project] 10.222.0.115 "GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade" status: 404 len: 111 microversion: 2.1 time: 0.074996 Jan 25 03:41:50.394700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 456/987] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:50 2022] GET /compute/v2.1/servers/11f511b5-f452-4aac-bfac-67d6c8ccfade => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:41:50.694572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:50.703118 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2e9ef9ec-135f-48fb-a823-50c3e773d53e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.404141 Jan 25 03:41:50.718872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 532/988] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:50 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:51.720095 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:51.721472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:51.729024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:51.729730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:51.730561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:51.730975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:51.874052 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:51.881538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-51ad8b9e-ca5c-410b-b19f-d6454c8bc38f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.165305 Jan 25 03:41:51.882350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 457/989] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:51 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:52.868330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-9bdc4034-45ba-470a-abdc-e761c0a0fc26 req-881853ef-59f4-4739-be44-e501db18c82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d", "name": "network-vif-plugged", "status": "completed", "tag": "b93b0fe2-4ab5-4c3c-81e5-39ac08ded566"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:41:52.870541 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:41:52.870541 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:41:52.877977 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-9bdc4034-45ba-470a-abdc-e761c0a0fc26 req-881853ef-59f4-4739-be44-e501db18c82b service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:52.878682 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-9bdc4034-45ba-470a-abdc-e761c0a0fc26 req-881853ef-59f4-4739-be44-e501db18c82b service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:52.891177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-9bdc4034-45ba-470a-abdc-e761c0a0fc26 req-881853ef-59f4-4739-be44-e501db18c82b service nova] Creating event network-vif-plugged:b93b0fe2-4ab5-4c3c-81e5-39ac08ded566 for instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d on hv-cinder-81901 Jan 25 03:41:52.898704 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-9bdc4034-45ba-470a-abdc-e761c0a0fc26 req-881853ef-59f4-4739-be44-e501db18c82b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282837 Jan 25 03:41:52.902402 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 533/990] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:41:52.902842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:52.905690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:52.918480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:52.919203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:52.920013 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:52.920543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:53.360002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:53.373341 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-53a832f5-e2f7-4ff6-986b-ca8547f53c11 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.477188 Jan 25 03:41:53.383108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 458/991] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:52 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:54.391131 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:54.394202 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:54.410058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:54.410526 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:54.411443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:54.411886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:54.569342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:54.578698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-22280395-97a4-45f8-b9c7-d960a83f2ab5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.191557 Jan 25 03:41:54.579445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 534/992] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:54 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:55.596827 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:55.597434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:55.603955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:55.604415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:55.605205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:55.605649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:55.841714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:55.849842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b8838a0f-f0c4-4c36-95ed-6669a8b3b795 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.256715 Jan 25 03:41:55.850956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 459/993] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:55 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:56.866254 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:56.867124 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:56.873563 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:56.874292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:56.875194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:56.875699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:57.017000 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:57.026470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a36136ad-b71c-46a2-bfa1-111416b3f98d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.163775 Jan 25 03:41:57.036825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 535/994] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:56 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:58.046941 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:58.048102 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:58.055280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:58.055945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:58.056816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:58.057336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:58.237209 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:58.247253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3dbca8c1-affa-414e-b4aa-c462359e5ea0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1263 microversion: 2.1 time: 0.206264 Jan 25 03:41:58.248290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 460/995] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:58 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:59.273325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:59.275034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:59.303306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:59.307998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:59.309832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:59.313129 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:59.534103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:59.544992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-34c5b269-fa4a-4286-8045-556fa390245f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1446 microversion: 2.1 time: 0.283890 Jan 25 03:41:59.545763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 536/996] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:59 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1446 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:41:59.564043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:41:59.564043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:41:59.575141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:59.575939 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:59.579502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:41:59.580849 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:41:59.828404 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:41:59.838048 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-99195d0f-d53c-42c8-88d6-3db63a9c1024 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1446 microversion: 2.1 time: 0.279539 Jan 25 03:41:59.839220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 461/997] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:41:59 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1446 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:02.706732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-f4744683-d85c-4fd0-a737-61962860b906 req-9b6e8e55-d5f7-4541-8840-0a8e1d649bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d", "tag": "b93b0fe2-4ab5-4c3c-81e5-39ac08ded566"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:02.709608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:02.709608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:42:02.719825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-f4744683-d85c-4fd0-a737-61962860b906 req-9b6e8e55-d5f7-4541-8840-0a8e1d649bb0 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:02.720530 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-f4744683-d85c-4fd0-a737-61962860b906 req-9b6e8e55-d5f7-4541-8840-0a8e1d649bb0 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:02.736127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-f4744683-d85c-4fd0-a737-61962860b906 req-9b6e8e55-d5f7-4541-8840-0a8e1d649bb0 service nova] Creating event network-changed:b93b0fe2-4ab5-4c3c-81e5-39ac08ded566 for instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d on hv-cinder-81901 Jan 25 03:42:02.745597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-f4744683-d85c-4fd0-a737-61962860b906 req-9b6e8e55-d5f7-4541-8840-0a8e1d649bb0 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044366 Jan 25 03:42:02.746544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 537/998] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:09.670315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5944c768-db77-4db0-a67c-a0445ea93216 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Action: 'create', calling method: .version_select at 0x7f33a8eec0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-193037485"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:09.691421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-5944c768-db77-4db0-a67c-a0445ea93216 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Getting quotas for project e4705507d68244c7a9a99369120f0a3a. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:42:09.695514 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-5944c768-db77-4db0-a67c-a0445ea93216 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Getting quotas for user 0e73df04cd61461b8811b4c57da7ac2a and project e4705507d68244c7a9a99369120f0a3a. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:42:10.053278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-5944c768-db77-4db0-a67c-a0445ea93216 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Getting quotas for project e4705507d68244c7a9a99369120f0a3a. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:42:10.057575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-5944c768-db77-4db0-a67c-a0445ea93216 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Getting quotas for user 0e73df04cd61461b8811b4c57da7ac2a and project e4705507d68244c7a9a99369120f0a3a. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:42:10.071051 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5944c768-db77-4db0-a67c-a0445ea93216 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.403791 Jan 25 03:42:10.071955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 462/999] 10.222.0.115 () {60 vars in 1162 bytes} [Tue Jan 25 03:42:09 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:10.119271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-143892900", "imageRef": "f5fab7cd-4587-4e33-b9cc-d587338d6020", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-193037485", "networks": [{"uuid": "7c8d81c6-dccc-4099-b6b2-a00ea0a64b80"}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:10.169266 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] validate_networks() for [('7c8d81c6-dccc-4099-b6b2-a00ea0a64b80', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:42:10.527360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:42:10.527793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:42:10.528276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:42:10.528692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:42:10.529111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:42:10.537906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:10.538361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:10.539294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:10.539834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:10.556297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Getting quotas for project e4705507d68244c7a9a99369120f0a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:42:10.560173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Getting quotas for user 0e73df04cd61461b8811b4c57da7ac2a and project e4705507d68244c7a9a99369120f0a3a. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:42:10.571652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:42:10.573951 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5fab7cd-4587-4e33-b9cc-d587338d6020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:42:10.690749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-327de444-50c9-41e0-a001-cbed9c8961c2 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.576871 Jan 25 03:42:10.691600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 538/1000] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:42:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:42:10.702087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-97e13d69-88b5-4268-a2f0-1e37d446d090 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:10.702719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-97e13d69-88b5-4268-a2f0-1e37d446d090 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:10.752887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-97e13d69-88b5-4268-a2f0-1e37d446d090 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:10.760881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-97e13d69-88b5-4268-a2f0-1e37d446d090 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1261 microversion: 2.1 time: 0.063029 Jan 25 03:42:10.761445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 463/1001] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:10 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1261 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:11.778424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:11.779041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:11.785915 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:11.786369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:11.787170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:11.787610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:11.846404 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:11.855840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e92366c1-8bf8-477a-9d91-ae03ce3f864d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1265 microversion: 2.1 time: 0.080491 Jan 25 03:42:11.855840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 539/1002] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:11 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:12.870809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:12.871516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:12.877971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:12.878428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:12.879247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:12.879708 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:12.964810 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:12.972143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-21182556-4cad-4f0a-a8d9-09be11d6f06d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1321 microversion: 2.1 time: 0.105335 Jan 25 03:42:12.973598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 464/1003] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:12 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1321 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:13.990381 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:13.991604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:13.999524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:14.000209 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:14.001780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:14.002440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:14.148425 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:14.157036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2ef5c03f-4bfb-4f92-aeb1-d4a27636ab0b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.170649 Jan 25 03:42:14.157623 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 540/1004] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:13 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:15.175027 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:15.175696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:15.182985 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:15.183462 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:15.184319 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:15.184755 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:15.331548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:15.338738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9a36bf22-a045-4227-adf8-be2e5d3f08d3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.167647 Jan 25 03:42:15.339345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 465/1005] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:15 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:16.355251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:16.355866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:16.362136 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:16.362591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:16.363397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:16.363839 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:16.499354 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:16.518284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-14e415f3-f411-4813-8f49-ee0e3fe45f19 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.166986 Jan 25 03:42:16.518865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 541/1006] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:16 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:17.536775 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:17.537577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:17.544777 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:17.545239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:17.546067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:17.546536 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:17.685815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:17.693986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9efc3c3f-1aa3-4f1c-b791-6f78c2172511 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.161246 Jan 25 03:42:17.694574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 466/1007] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:17 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:18.712962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:18.712962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:18.716840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:18.717296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:18.718084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:18.718529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:18.855905 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:18.862913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-72a09b67-8156-4f65-b5d4-974e187e6df9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.157091 Jan 25 03:42:18.863497 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 542/1008] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:18 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:19.880975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:19.882003 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:19.889522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:19.897000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:19.897000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:19.897000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:20.035152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:20.043391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7642dfbb-cc85-4954-ae00-382c61f5dc49 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.166888 Jan 25 03:42:20.043967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 467/1009] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:19 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:21.060288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:21.063833 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:21.067914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:21.068910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:21.069716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:21.070170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:21.224543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:21.232960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-28e0ef5f-9e6e-4ed8-84f5-3a4c5c589a3b tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.177343 Jan 25 03:42:21.233540 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 543/1010] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:21 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:22.250101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:22.250668 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:22.256786 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:22.257239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:22.258037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:22.258512 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:22.420968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:22.429486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9ca9ef32-970f-476d-9318-c4689dc82bb6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.183131 Jan 25 03:42:22.431999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 468/1011] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:22 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:23.447943 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:23.448599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:23.454848 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:23.455339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:23.456117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:23.456691 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:23.600517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:23.618944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3c7aa6ca-aa9e-4b6d-a05d-1dd01bee8eab tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.165019 Jan 25 03:42:23.618944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 544/1012] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:23 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:24.625113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:24.625752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:24.631941 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:24.632397 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:24.633174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:24.634309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:24.772124 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:24.780499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-31387712-cf09-443e-a912-8a617dc9247d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.159158 Jan 25 03:42:24.781071 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 469/1013] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:24 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:25.801197 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:25.802179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:25.809991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:25.810583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:25.811648 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:25.812156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:25.961592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:25.969300 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e062e1fa-e4ad-41fd-9222-b32727412aa9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.172813 Jan 25 03:42:25.969979 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 545/1014] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:25 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:26.986242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:26.986957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:26.993829 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:26.994272 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:26.995046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:26.995505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:27.126511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:27.134025 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-79014e19-d3fa-42e3-aa6b-9e05faddaa71 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.151177 Jan 25 03:42:27.134590 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 470/1015] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:26 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:28.150108 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:28.150733 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:28.157083 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:28.157538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:28.158326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:28.158770 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:28.287544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:28.295186 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5d9a8b9b-1efb-4c61-ad6c-aaae585130a8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.149289 Jan 25 03:42:28.296445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 546/1016] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:28 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:28.840630 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-8a55a30a-8df1-480f-a3f7-56c7fd461647 req-64026967-6088-4208-9506-2641c34977f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447c6612-9f1b-4064-b6ed-7ee5dc89f827", "tag": "596e847a-8586-402f-8511-f40dab535655"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:28.842322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:28.842322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:42:28.849412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-8a55a30a-8df1-480f-a3f7-56c7fd461647 req-64026967-6088-4208-9506-2641c34977f2 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:28.849859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-8a55a30a-8df1-480f-a3f7-56c7fd461647 req-64026967-6088-4208-9506-2641c34977f2 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:28.864305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-8a55a30a-8df1-480f-a3f7-56c7fd461647 req-64026967-6088-4208-9506-2641c34977f2 service nova] Creating event network-changed:596e847a-8586-402f-8511-f40dab535655 for instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 on hv-cinder-81901 Jan 25 03:42:28.870332 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-8a55a30a-8df1-480f-a3f7-56c7fd461647 req-64026967-6088-4208-9506-2641c34977f2 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039185 Jan 25 03:42:28.871316 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 471/1017] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:29.314169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:29.315074 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:29.321967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:29.322426 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:29.323607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:29.323698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:29.458444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:29.465946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-053bca9a-7654-4c28-9ea4-4e5b3eb56cf5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.155627 Jan 25 03:42:29.466512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 547/1018] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:29 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:30.482474 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:30.483217 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:30.489446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:30.489887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:30.494153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:30.494153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:30.620944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:30.628041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-969838b9-c21e-4735-9d71-575c316ea222 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.150009 Jan 25 03:42:30.628609 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 472/1019] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:30 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:31.644861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:31.645480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:31.651578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:31.652035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:31.652815 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:31.653258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:31.779852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:31.787087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0977dbd2-27e2-41ea-9e5d-fddc863b7170 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.145818 Jan 25 03:42:31.787659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 548/1020] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:31 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:32.310554 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bb1dd8a6-6a0f-4d89-9bcb-56bb514a60a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:32.311125 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bb1dd8a6-6a0f-4d89-9bcb-56bb514a60a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:32.317681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb1dd8a6-6a0f-4d89-9bcb-56bb514a60a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.318133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb1dd8a6-6a0f-4d89-9bcb-56bb514a60a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.318915 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb1dd8a6-6a0f-4d89-9bcb-56bb514a60a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.319465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb1dd8a6-6a0f-4d89-9bcb-56bb514a60a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.348348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bb1dd8a6-6a0f-4d89-9bcb-56bb514a60a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments/2ffed6ed-ee6c-4bb6-a2e9-27ac1dfbf832" status: 200 len: 194 microversion: 2.20 time: 0.041663 Jan 25 03:42:32.348934 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 473/1021] 10.222.0.115 () {60 vars in 1458 bytes} [Tue Jan 25 03:42:32 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments/2ffed6ed-ee6c-4bb6-a2e9-27ac1dfbf832 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:42:32.409984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:32.412544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:32.416707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.417162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.418184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.418713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.495305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lazy-loading 'services' on Instance uuid b5c1179f-67c0-4198-8933-7cabe5c964f3 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:42:32.630385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-952b0ff9-90d3-497b-95bc-670608579e73 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments/2ffed6ed-ee6c-4bb6-a2e9-27ac1dfbf832" status: 202 len: 0 microversion: 2.20 time: 0.224203 Jan 25 03:42:32.630996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 549/1022] 10.222.0.115 () {60 vars in 1461 bytes} [Tue Jan 25 03:42:32 2022] DELETE /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments/2ffed6ed-ee6c-4bb6-a2e9-27ac1dfbf832 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:42:32.639277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-202cd286-9b72-4a0e-b34a-52ac62a16b45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:32.640191 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-202cd286-9b72-4a0e-b34a-52ac62a16b45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:32.645960 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202cd286-9b72-4a0e-b34a-52ac62a16b45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.646414 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202cd286-9b72-4a0e-b34a-52ac62a16b45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.647229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202cd286-9b72-4a0e-b34a-52ac62a16b45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.647699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-202cd286-9b72-4a0e-b34a-52ac62a16b45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.676901 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-202cd286-9b72-4a0e-b34a-52ac62a16b45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041465 Jan 25 03:42:32.677457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 474/1023] 10.222.0.115 () {60 vars in 1347 bytes} [Tue Jan 25 03:42:32 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:42:32.804729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:32.806238 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:32.812609 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.813058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.813864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:32.814310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:32.945388 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:32.951687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e938358a-8375-4f11-9c4c-bf71fc8e9053 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.151573 Jan 25 03:42:32.952272 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 550/1024] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:32 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:33.689040 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-14f12757-5b54-41ae-bf70-d3def4e5379b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:33.697583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-14f12757-5b54-41ae-bf70-d3def4e5379b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:33.697583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14f12757-5b54-41ae-bf70-d3def4e5379b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:33.697583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14f12757-5b54-41ae-bf70-d3def4e5379b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:33.698190 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14f12757-5b54-41ae-bf70-d3def4e5379b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:33.698619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14f12757-5b54-41ae-bf70-d3def4e5379b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:33.726729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-14f12757-5b54-41ae-bf70-d3def4e5379b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041506 Jan 25 03:42:33.728620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 475/1025] 10.222.0.115 () {60 vars in 1347 bytes} [Tue Jan 25 03:42:33 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:42:33.968057 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:33.968616 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:33.974872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:33.975387 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:33.976229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:33.976672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:34.110435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:34.118763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-80e5f10d-51bd-4307-b9c0-0fac0f0bdddf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.154433 Jan 25 03:42:34.120038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 551/1026] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:33 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:34.737877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6a24ff2a-82e3-4f09-b4e0-3528e99d2909 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:34.738781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6a24ff2a-82e3-4f09-b4e0-3528e99d2909 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:34.745385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a24ff2a-82e3-4f09-b4e0-3528e99d2909 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:34.745843 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a24ff2a-82e3-4f09-b4e0-3528e99d2909 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:34.746624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a24ff2a-82e3-4f09-b4e0-3528e99d2909 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:34.747085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6a24ff2a-82e3-4f09-b4e0-3528e99d2909 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:34.776413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6a24ff2a-82e3-4f09-b4e0-3528e99d2909 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041654 Jan 25 03:42:34.777001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 476/1027] 10.222.0.115 () {60 vars in 1347 bytes} [Tue Jan 25 03:42:34 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:34.834469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:34.834972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:34.841516 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:34.841974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:34.842760 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:34.843308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:34.868425 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:42:35.094087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9fa8e30c-d1fe-42ac-929d-a328abfe7355 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 204 len: 0 microversion: 2.20 time: 0.263010 Jan 25 03:42:35.094762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 552/1028] 10.222.0.115 () {60 vars in 1284 bytes} [Tue Jan 25 03:42:34 2022] DELETE /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 25 03:42:35.102820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:35.103457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:35.109527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:35.111151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:35.111151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:35.111367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:35.141287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:35.142029 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:35.148044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:35.149304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:35.149304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:35.149743 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:35.249158 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:35.257158 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:35.258661 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:35.259854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7481faa4-807a-434b-8c8a-a40d06bb0295 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.160736 Jan 25 03:42:35.260421 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 477/1029] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:35 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:35.281652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:35.289005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-99b48617-6455-45ab-b132-fdb080e86cef tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.152372 Jan 25 03:42:35.295000 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 553/1030] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:35 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:42:36.279469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:36.280068 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:36.286327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:36.286785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:36.287596 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:36.288045 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:36.305437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:36.306135 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:36.312980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:36.313433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:36.314219 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:36.314909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:36.420371 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:36.428645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:36.430138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:36.431342 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8e70cb03-ca23-4acf-81f9-8668979eaf39 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.156120 Jan 25 03:42:36.431884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 478/1031] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:36 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:36.447765 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:36.454895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-396b4921-72f4-4d13-95d9-aac7cfee3c56 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.153085 Jan 25 03:42:36.455494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 554/1032] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:36 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:42:36.848896 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-0e4617d1-babb-4015-b39b-8df39b8aa3fc req-e513001e-6c59-444f-be2a-4cfd9a23ee95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447c6612-9f1b-4064-b6ed-7ee5dc89f827", "name": "network-vif-plugged", "status": "completed", "tag": "596e847a-8586-402f-8511-f40dab535655"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:36.850567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:36.850567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:42:36.858419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-0e4617d1-babb-4015-b39b-8df39b8aa3fc req-e513001e-6c59-444f-be2a-4cfd9a23ee95 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:36.858867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-0e4617d1-babb-4015-b39b-8df39b8aa3fc req-e513001e-6c59-444f-be2a-4cfd9a23ee95 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:36.869347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-0e4617d1-babb-4015-b39b-8df39b8aa3fc req-e513001e-6c59-444f-be2a-4cfd9a23ee95 service nova] Creating event network-vif-plugged:596e847a-8586-402f-8511-f40dab535655 for instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 on hv-cinder-81901 Jan 25 03:42:36.875216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-0e4617d1-babb-4015-b39b-8df39b8aa3fc req-e513001e-6c59-444f-be2a-4cfd9a23ee95 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030018 Jan 25 03:42:36.875816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 479/1033] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:37.450189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:37.451085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:37.457307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:37.457766 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:37.458550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:37.458992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:37.471991 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:37.472718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:37.480965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:37.481467 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:37.482452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:37.482896 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:37.591430 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:37.599376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:37.600898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:37.602054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a6328a06-66d5-4e0e-a12f-da5a43b45d88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1727 microversion: 2.20 time: 0.156282 Jan 25 03:42:37.602616 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 555/1034] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:37 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:37.788624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:37.796698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-551e70ba-c562-46e8-8122-164e7dea46cb tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.328742 Jan 25 03:42:37.797279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 480/1035] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:37 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:38.280281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-08b5d349-9234-4447-9404-b82bf2c132c2 req-16673ef9-4c5d-46c5-8517-7cac831c8d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c1179f-67c0-4198-8933-7cabe5c964f3", "name": "network-vif-deleted", "tag": "23790178-4f79-4bcf-a17f-bd8e5abf0427"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:38.282066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:38.282066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:42:38.288937 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-08b5d349-9234-4447-9404-b82bf2c132c2 req-16673ef9-4c5d-46c5-8517-7cac831c8d4e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:38.293811 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-08b5d349-9234-4447-9404-b82bf2c132c2 req-16673ef9-4c5d-46c5-8517-7cac831c8d4e service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:38.301123 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-08b5d349-9234-4447-9404-b82bf2c132c2 req-16673ef9-4c5d-46c5-8517-7cac831c8d4e service nova] Creating event network-vif-deleted:23790178-4f79-4bcf-a17f-bd8e5abf0427 for instance b5c1179f-67c0-4198-8933-7cabe5c964f3 on hv-cinder-81901 Jan 25 03:42:38.306157 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-08b5d349-9234-4447-9404-b82bf2c132c2 req-16673ef9-4c5d-46c5-8517-7cac831c8d4e service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030666 Jan 25 03:42:38.306761 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 556/1036] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:38.622979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:38.623882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:38.635316 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:38.635770 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:38.636547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:38.637924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:38.671246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:38.671942 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:38.672544 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lazy-loading 'fault' on Instance uuid b5c1179f-67c0-4198-8933-7cabe5c964f3 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:42:38.723662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:38.733033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:38.734859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:38.736174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bf4dd61d-a1a3-466d-b8e9-174a2e4e3cd5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 200 len: 1375 microversion: 2.20 time: 0.117973 Jan 25 03:42:38.736817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 481/1037] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:38 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 1375 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:38.818753 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:38.822567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:38.827758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:38.828262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:38.829284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:38.829727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:38.982085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:38.988270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e8fa68ba-2103-43de-957d-917c701e63ad tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1361 microversion: 2.1 time: 0.173926 Jan 25 03:42:38.988795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 557/1038] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:38 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:39.755418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:39.756030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:39.763105 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:39.763591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:39.764377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:39.764816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:39.777989 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] HTTP exception thrown: Instance b5c1179f-67c0-4198-8933-7cabe5c964f3 could not be found. Jan 25 03:42:39.778584 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Returning 404 to user: Instance b5c1179f-67c0-4198-8933-7cabe5c964f3 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:42:39.779439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c5bb9e98-b956-4f6d-b7d5-d864ea3789d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 404 len: 111 microversion: 2.20 time: 0.027792 Jan 25 03:42:39.780002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 482/1039] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:39 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:42:39.788014 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-406e1c28-1171-46e9-b114-c1f368121f27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '.version_select at 0x7f33a8436040>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:39.888427 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-406e1c28-1171-46e9-b114-c1f368121f27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803624160" status: 204 len: 0 microversion: 2.20 time: 0.103909 Jan 25 03:42:39.889060 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 558/1040] 10.222.0.115 () {60 vars in 1266 bytes} [Tue Jan 25 03:42:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1803624160 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 25 03:42:40.011005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:40.014107 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:40.020242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.020655 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.021434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.021871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.195497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:40.203294 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e6e7961d-1f32-4c72-8a3c-8733f1838864 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1551 microversion: 2.1 time: 0.199239 Jan 25 03:42:40.203976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 483/1041] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:40 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1551 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:40.219323 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:40.219939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:40.225854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.226309 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.227122 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.227573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.369947 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:40.378055 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-de8a9d69-85c2-48a1-8c11-232eafe151b9 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1551 microversion: 2.1 time: 0.162384 Jan 25 03:42:40.378750 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 559/1042] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:40 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:40.394008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:40.397389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:40.397389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:42:40.398378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:40.399494 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Searching by: {'deleted': False, 'project_id': 'e4705507d68244c7a9a99369120f0a3a'} {{(pid=123363) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 25 03:42:40.409627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.410072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.410936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.411486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.502981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.multi_cell_list [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123363) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 25 03:42:40.756231 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b5e7c3d5-90ec-4731-8186-e66b464b4e97 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.365947 Jan 25 03:42:40.756976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 484/1043] 10.222.0.115 () {58 vars in 1129 bytes} [Tue Jan 25 03:42:40 2022] GET /compute/v2.1/servers => generated 344 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:40.768006 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:40.768845 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:40.775030 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.775518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.776308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:40.776749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:40.797996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7b5400b7-a4b7-453f-9b02-39bd218a0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'create', calling method: .version_select at 0x7f33a8ccc550>, body: {"keypair": {"name": "tempest-keypair-1113852080"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:40.813018 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-7b5400b7-a4b7-453f-9b02-39bd218a0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:42:40.817331 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-7b5400b7-a4b7-453f-9b02-39bd218a0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for user 8f0cd1ec82a347f2babd996424cbb0b2 and project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:42:40.950565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:40.959637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-73838a87-9958-490b-a444-041e3ca03683 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1551 microversion: 2.1 time: 0.194953 Jan 25 03:42:40.960462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 560/1044] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:40 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1551 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:41.446688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-7b5400b7-a4b7-453f-9b02-39bd218a0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:42:41.450998 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-7b5400b7-a4b7-453f-9b02-39bd218a0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for user 8f0cd1ec82a347f2babd996424cbb0b2 and project 33c5e2c89460402987c96eb3c3340a68. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:42:41.463365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7b5400b7-a4b7-453f-9b02-39bd218a0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.669338 Jan 25 03:42:41.463961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 485/1045] 10.222.0.115 () {62 vars in 1203 bytes} [Tue Jan 25 03:42:40 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 671 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 25 03:42:43.664890 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-10064416", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f476d920-246d-45fc-9288-e583ed5f94c0"}], "security_groups": [{"name": "tempest-securitygroup--888510614"}], "key_name": "tempest-keypair-1113852080", "user_data": "}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:43.764434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] validate_networks() for [('f476d920-246d-45fc-9288-e583ed5f94c0', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:42:44.103069 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-02e5e7b2-820f-41c9-9f34-9a8b6658a3c6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a3a650a-de2a-4eab-a5dd-836a0c4cfc75"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:44.104126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-02e5e7b2-820f-41c9-9f34-9a8b6658a3c6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:44.110898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02e5e7b2-820f-41c9-9f34-9a8b6658a3c6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:44.116075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02e5e7b2-820f-41c9-9f34-9a8b6658a3c6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:44.116075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02e5e7b2-820f-41c9-9f34-9a8b6658a3c6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:44.116075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02e5e7b2-820f-41c9-9f34-9a8b6658a3c6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:44.127130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:42:44.127562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:42:44.128064 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:42:44.128479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:42:44.128900 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:42:44.138072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:44.138527 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:44.139361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:44.139798 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:44.156640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for project 33c5e2c89460402987c96eb3c3340a68. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:42:44.160774 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Getting quotas for user 8f0cd1ec82a347f2babd996424cbb0b2 and project 33c5e2c89460402987c96eb3c3340a68. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:42:44.172349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:42:44.175715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:42:44.318102 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6eaf5196-a848-46ba-b203-c799013d145d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.659645 Jan 25 03:42:44.318753 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 561/1046] 10.222.0.115 () {62 vars in 1192 bytes} [Tue Jan 25 03:42:43 2022] POST /compute/v2.1/servers => generated 403 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 25 03:42:44.328442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1fb54a1b-420e-4820-b4a0-adb6d0e63340 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:44.329163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1fb54a1b-420e-4820-b4a0-adb6d0e63340 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:44.382358 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1fb54a1b-420e-4820-b4a0-adb6d0e63340 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:44.390010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1fb54a1b-420e-4820-b4a0-adb6d0e63340 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:44.391745 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-1fb54a1b-420e-4820-b4a0-adb6d0e63340 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:44.393051 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1fb54a1b-420e-4820-b4a0-adb6d0e63340 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1284 microversion: 2.20 time: 0.068350 Jan 25 03:42:44.393608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 562/1047] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:44 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1284 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:42:44.874002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-02e5e7b2-820f-41c9-9f34-9a8b6658a3c6 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.775037 Jan 25 03:42:44.874631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 486/1048] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:42:44 2022] POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:42:45.411181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:45.411933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:45.419023 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:45.419462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:45.420251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:45.420695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:45.483430 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:45.491333 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:45.492903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:45.493990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f09864c3-8023-4c26-a9f9-06f1468ffd83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1288 microversion: 2.20 time: 0.086544 Jan 25 03:42:45.494540 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 563/1049] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:45 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:46.514049 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:46.514947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:46.522701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:46.523315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:46.524222 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:46.524723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:46.604520 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:46.612568 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:46.614891 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:46.616962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-22201d77-47b8-4e79-b7a3-3c5413092ad1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1354 microversion: 2.20 time: 0.108217 Jan 25 03:42:46.617920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 487/1050] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:46 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:47.639883 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:47.640494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:47.646854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:47.647364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:47.648157 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:47.648595 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:47.792529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:47.793359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:47.794887 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:47.796218 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-37435a81-214e-4d24-893b-0860ae57ebfa tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.160579 Jan 25 03:42:47.796780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 564/1051] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:47 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:48.349411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-57f6db4a-5169-4135-9e7f-a3498947b072 req-73ce7c9c-9241-4731-852e-a169f447207d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8302b8-b04f-40ea-a9ff-2461018e7962", "tag": "9f6cee72-9dab-452f-955a-9024f4b6b9f4"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:48.350986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:48.350986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:42:48.362954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-57f6db4a-5169-4135-9e7f-a3498947b072 req-73ce7c9c-9241-4731-852e-a169f447207d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:48.369006 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-57f6db4a-5169-4135-9e7f-a3498947b072 req-73ce7c9c-9241-4731-852e-a169f447207d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:48.378981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-57f6db4a-5169-4135-9e7f-a3498947b072 req-73ce7c9c-9241-4731-852e-a169f447207d service nova] Creating event network-changed:9f6cee72-9dab-452f-955a-9024f4b6b9f4 for instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 on hv-cinder-81901 Jan 25 03:42:48.383852 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-57f6db4a-5169-4135-9e7f-a3498947b072 req-73ce7c9c-9241-4731-852e-a169f447207d service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039407 Jan 25 03:42:48.384597 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 488/1052] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:48.814291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:48.814897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:48.821305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:48.821765 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:48.822548 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:48.822987 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:48.952449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:48.960404 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:48.961980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:48.962997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-aa436864-4f51-4f67-950c-95e616db8f80 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.152675 Jan 25 03:42:48.963574 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 565/1053] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:48 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:42:49.984236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:49.984881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:49.990994 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:49.994362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:49.994362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:49.994362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:50.124517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:50.132222 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:50.133725 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:50.134856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0c60515f-0f3b-4ad1-b0e4-26f749da1ec4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.156660 Jan 25 03:42:50.135441 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 489/1054] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:49 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:51.152599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:51.153730 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:51.159991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:51.160440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:51.161204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:51.161640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:51.294714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:51.302400 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:51.303922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:51.305012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bd197d56-5633-4bd1-987e-8a3062010835 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.156183 Jan 25 03:42:51.305581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 566/1055] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:51 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:52.322539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:52.323180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:52.330309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:52.332768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:52.332768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:52.332768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:52.465402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:52.473254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:52.484529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:52.484529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-eaa19300-d4f5-4dfe-88b5-dcdd83f71a14 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.157198 Jan 25 03:42:52.484529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 490/1056] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:52 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:42:53.428017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:53.428626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:53.435498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:53.435956 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:53.436738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:53.437178 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:53.494485 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:53.495127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:53.502451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:53.503272 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:53.504080 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:53.504516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:53.639940 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:53.647677 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:53.649175 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:53.650279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a2cee59e-edba-4eec-95ab-c251514d33c4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.159781 Jan 25 03:42:53.650835 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 491/1057] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:53 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:42:53.716056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:53.723797 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-785110b3-2895-4680-a697-478673d198f1 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1597 microversion: 2.1 time: 0.299384 Jan 25 03:42:53.724362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 567/1058] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:53 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1597 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:42:54.669463 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:54.670072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:54.675961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:54.676416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:54.677257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:54.677704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:54.814077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:54.823546 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:54.825511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:54.827211 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2a2d05b1-d9d7-44dc-989c-0f12dc7751a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.162572 Jan 25 03:42:54.827778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 492/1059] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:54 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:54.973627 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-a4284b77-e762-45fc-891d-a805561e21e6 req-f01095d2-59dd-44eb-b9c8-be74221dbab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8302b8-b04f-40ea-a9ff-2461018e7962", "name": "network-vif-plugged", "status": "completed", "tag": "9f6cee72-9dab-452f-955a-9024f4b6b9f4"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:54.980692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:54.980692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:42:54.996226 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a4284b77-e762-45fc-891d-a805561e21e6 req-f01095d2-59dd-44eb-b9c8-be74221dbab6 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:54.996741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a4284b77-e762-45fc-891d-a805561e21e6 req-f01095d2-59dd-44eb-b9c8-be74221dbab6 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:55.008573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-a4284b77-e762-45fc-891d-a805561e21e6 req-f01095d2-59dd-44eb-b9c8-be74221dbab6 service nova] Creating event network-vif-plugged:9f6cee72-9dab-452f-955a-9024f4b6b9f4 for instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 on hv-cinder-81901 Jan 25 03:42:55.013144 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-a4284b77-e762-45fc-891d-a805561e21e6 req-f01095d2-59dd-44eb-b9c8-be74221dbab6 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043363 Jan 25 03:42:55.014009 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 568/1060] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:55.844723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:55.845269 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:55.851498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:55.851951 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:55.852743 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:55.853392 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:55.986299 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:55.994177 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:55.995746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:55.997519 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ad57df03-f38a-4fcd-94e3-176497504f38 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.156982 Jan 25 03:42:55.998075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 493/1061] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:55 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:56.054084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-638a08a4-66bd-4b77-ba1b-abab6b1c807a req-e3b1d4a4-8ede-40fd-b977-ab47099c8c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447c6612-9f1b-4064-b6ed-7ee5dc89f827", "tag": "596e847a-8586-402f-8511-f40dab535655"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:56.055696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:56.055696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:42:56.064039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-638a08a4-66bd-4b77-ba1b-abab6b1c807a req-e3b1d4a4-8ede-40fd-b977-ab47099c8c3d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:56.064592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-638a08a4-66bd-4b77-ba1b-abab6b1c807a req-e3b1d4a4-8ede-40fd-b977-ab47099c8c3d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:56.075776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-638a08a4-66bd-4b77-ba1b-abab6b1c807a req-e3b1d4a4-8ede-40fd-b977-ab47099c8c3d service nova] Creating event network-changed:596e847a-8586-402f-8511-f40dab535655 for instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 on hv-cinder-81901 Jan 25 03:42:56.080878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-638a08a4-66bd-4b77-ba1b-abab6b1c807a req-e3b1d4a4-8ede-40fd-b977-ab47099c8c3d service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031232 Jan 25 03:42:56.083558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 569/1062] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:42:57.018309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:57.018894 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:57.027083 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:57.027719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:57.028879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:57.029331 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:57.171663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:57.179922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:57.181492 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:57.182581 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-02bae2c5-fd46-4839-9213-fb5afdf50da7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1409 microversion: 2.20 time: 0.168081 Jan 25 03:42:57.183205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 494/1063] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:57 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:58.202383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:58.203268 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:58.209789 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:58.210242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:58.211024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:58.211488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:58.371684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:58.379945 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:58.381484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:58.382665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-aa279471-d34f-40e7-a9b5-e4063014261d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1600 microversion: 2.20 time: 0.185341 Jan 25 03:42:58.383242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 570/1064] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:42:58 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:42:58.400474 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a3cfd674-aea4-49b9-ab7f-a6ff27ef99a1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:58.400945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a3cfd674-aea4-49b9-ab7f-a6ff27ef99a1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:58.407236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3cfd674-aea4-49b9-ab7f-a6ff27ef99a1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:58.407683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3cfd674-aea4-49b9-ab7f-a6ff27ef99a1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:58.408457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3cfd674-aea4-49b9-ab7f-a6ff27ef99a1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:58.408890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a3cfd674-aea4-49b9-ab7f-a6ff27ef99a1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:58.492569 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a3cfd674-aea4-49b9-ab7f-a6ff27ef99a1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095556 Jan 25 03:42:58.493168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 495/1065] 10.222.0.115 () {60 vars in 1320 bytes} [Tue Jan 25 03:42:58 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:42:58.587422 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1156778441"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:58.587964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:58.594444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:58.594929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:58.595765 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:58.596186 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:58.864682 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.network.security_group_api [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Adding security group e8bc47c3-42cf-496d-8551-6de4cc3f0491 to port 596e847a-8586-402f-8511-f40dab535655 Jan 25 03:42:59.686478 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1667ae64-370e-4df8-9265-cd562bf78fb3 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/action" status: 202 len: 0 microversion: 2.1 time: 1.102945 Jan 25 03:42:59.687127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 571/1066] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:42:58 2022] POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/action => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:42:59.696066 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:42:59.697443 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:42:59.704265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-a943a208-204e-480e-8836-3c4e4f4e1325 req-1f7c1f95-a6db-4f63-8c9e-f5ad1941fd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447c6612-9f1b-4064-b6ed-7ee5dc89f827", "tag": "596e847a-8586-402f-8511-f40dab535655"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:42:59.707034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:42:59.707034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:42:59.707397 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:59.711328 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:59.713123 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:59.716184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:59.717556 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a943a208-204e-480e-8836-3c4e4f4e1325 req-1f7c1f95-a6db-4f63-8c9e-f5ad1941fd3b service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:42:59.718231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-a943a208-204e-480e-8836-3c4e4f4e1325 req-1f7c1f95-a6db-4f63-8c9e-f5ad1941fd3b service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:42:59.745817 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-a943a208-204e-480e-8836-3c4e4f4e1325 req-1f7c1f95-a6db-4f63-8c9e-f5ad1941fd3b service nova] Creating event network-changed:596e847a-8586-402f-8511-f40dab535655 for instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 on hv-cinder-81901 Jan 25 03:42:59.752027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-a943a208-204e-480e-8836-3c4e4f4e1325 req-1f7c1f95-a6db-4f63-8c9e-f5ad1941fd3b service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053231 Jan 25 03:42:59.753121 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 572/1067] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:42:59.943012 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:42:59.951762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-599860f8-7c1a-4b97-b211-3489805ef529 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1762 microversion: 2.1 time: 0.259758 Jan 25 03:42:59.971788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 496/1068] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:42:59 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1762 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:00.038200 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d680ec84-e156-4224-b805-d98c77db329f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:00.039732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d680ec84-e156-4224-b805-d98c77db329f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:00.046888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d680ec84-e156-4224-b805-d98c77db329f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:00.047377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d680ec84-e156-4224-b805-d98c77db329f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:00.048388 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d680ec84-e156-4224-b805-d98c77db329f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:00.049132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d680ec84-e156-4224-b805-d98c77db329f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:00.160436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d680ec84-e156-4224-b805-d98c77db329f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.126274 Jan 25 03:43:00.163727 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 573/1069] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:00 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:01.171489 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ed67c380-c002-4dd4-acf2-0a6d429782a9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:01.172471 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ed67c380-c002-4dd4-acf2-0a6d429782a9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:01.179154 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed67c380-c002-4dd4-acf2-0a6d429782a9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:01.179619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed67c380-c002-4dd4-acf2-0a6d429782a9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:01.180407 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed67c380-c002-4dd4-acf2-0a6d429782a9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:01.180853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ed67c380-c002-4dd4-acf2-0a6d429782a9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:01.283968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ed67c380-c002-4dd4-acf2-0a6d429782a9 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.116057 Jan 25 03:43:01.284607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 497/1070] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:01 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:01.786683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-88bd1c4c-8bee-4404-8deb-69389149407d req-c58e858f-76cf-437d-90c5-7a40a8237297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b8302b8-b04f-40ea-a9ff-2461018e7962", "tag": "9f6cee72-9dab-452f-955a-9024f4b6b9f4"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:01.788299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:43:01.788299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:43:01.796765 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-88bd1c4c-8bee-4404-8deb-69389149407d req-c58e858f-76cf-437d-90c5-7a40a8237297 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:01.797215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-88bd1c4c-8bee-4404-8deb-69389149407d req-c58e858f-76cf-437d-90c5-7a40a8237297 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:01.808171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-88bd1c4c-8bee-4404-8deb-69389149407d req-c58e858f-76cf-437d-90c5-7a40a8237297 service nova] Creating event network-changed:9f6cee72-9dab-452f-955a-9024f4b6b9f4 for instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 on hv-cinder-81901 Jan 25 03:43:01.814008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-88bd1c4c-8bee-4404-8deb-69389149407d req-c58e858f-76cf-437d-90c5-7a40a8237297 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030966 Jan 25 03:43:01.815778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 574/1071] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:43:02.295400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-439ab06e-b425-4ae6-aa12-40be8ff3abc4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:02.296409 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-439ab06e-b425-4ae6-aa12-40be8ff3abc4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:02.303219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439ab06e-b425-4ae6-aa12-40be8ff3abc4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:02.303674 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439ab06e-b425-4ae6-aa12-40be8ff3abc4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:02.304460 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439ab06e-b425-4ae6-aa12-40be8ff3abc4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:02.304899 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-439ab06e-b425-4ae6-aa12-40be8ff3abc4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:02.411650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-439ab06e-b425-4ae6-aa12-40be8ff3abc4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.121117 Jan 25 03:43:02.415171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 498/1072] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:02 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:43:03.424372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3cc97696-1080-4696-8e96-3319d5a7614f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:03.425374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3cc97696-1080-4696-8e96-3319d5a7614f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:03.431593 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc97696-1080-4696-8e96-3319d5a7614f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:03.432053 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc97696-1080-4696-8e96-3319d5a7614f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:03.432837 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc97696-1080-4696-8e96-3319d5a7614f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:03.433276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cc97696-1080-4696-8e96-3319d5a7614f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:03.523289 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3cc97696-1080-4696-8e96-3319d5a7614f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.103281 Jan 25 03:43:03.523911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 575/1073] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:03 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:04.534771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2bf8f251-fb1c-4142-b79f-82286631142f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:04.535802 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2bf8f251-fb1c-4142-b79f-82286631142f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:04.542670 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bf8f251-fb1c-4142-b79f-82286631142f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:04.543884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bf8f251-fb1c-4142-b79f-82286631142f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:04.545226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bf8f251-fb1c-4142-b79f-82286631142f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:04.545831 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2bf8f251-fb1c-4142-b79f-82286631142f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:04.628102 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2bf8f251-fb1c-4142-b79f-82286631142f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.097239 Jan 25 03:43:04.628643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 499/1074] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:04 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:05.639878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8dab077e-586b-430a-b054-773039a68bf2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:05.640877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8dab077e-586b-430a-b054-773039a68bf2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:05.647755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8dab077e-586b-430a-b054-773039a68bf2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:05.648220 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8dab077e-586b-430a-b054-773039a68bf2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:05.648996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8dab077e-586b-430a-b054-773039a68bf2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:05.649437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8dab077e-586b-430a-b054-773039a68bf2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:05.731970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8dab077e-586b-430a-b054-773039a68bf2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.096579 Jan 25 03:43:05.732593 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 576/1075] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:05 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:06.743347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b7c0aa2a-386e-4e99-84f5-fdc15c57df3c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:06.744366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b7c0aa2a-386e-4e99-84f5-fdc15c57df3c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:06.752117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7c0aa2a-386e-4e99-84f5-fdc15c57df3c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:06.752572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7c0aa2a-386e-4e99-84f5-fdc15c57df3c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:06.753429 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7c0aa2a-386e-4e99-84f5-fdc15c57df3c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:06.753872 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7c0aa2a-386e-4e99-84f5-fdc15c57df3c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:06.836134 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b7c0aa2a-386e-4e99-84f5-fdc15c57df3c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.096872 Jan 25 03:43:06.836760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 500/1076] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:06 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:07.847536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-36aa7ef9-53c5-4be3-b5bb-b063da8dec2f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:07.848554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-36aa7ef9-53c5-4be3-b5bb-b063da8dec2f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:07.856165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36aa7ef9-53c5-4be3-b5bb-b063da8dec2f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:07.856631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36aa7ef9-53c5-4be3-b5bb-b063da8dec2f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:07.857407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36aa7ef9-53c5-4be3-b5bb-b063da8dec2f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:07.857849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36aa7ef9-53c5-4be3-b5bb-b063da8dec2f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:07.945075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-36aa7ef9-53c5-4be3-b5bb-b063da8dec2f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.101472 Jan 25 03:43:07.945720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 577/1077] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:07 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:08.956610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6164be30-9205-46aa-8cf6-391467bbf8fd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:08.958039 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6164be30-9205-46aa-8cf6-391467bbf8fd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:08.965304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6164be30-9205-46aa-8cf6-391467bbf8fd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:08.965751 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6164be30-9205-46aa-8cf6-391467bbf8fd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:08.966534 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6164be30-9205-46aa-8cf6-391467bbf8fd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:08.966963 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6164be30-9205-46aa-8cf6-391467bbf8fd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:09.053976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6164be30-9205-46aa-8cf6-391467bbf8fd tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 14 microversion: 2.20 time: 0.101409 Jan 25 03:43:09.054706 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 501/1078] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:08 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:10.065639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-53802908-99b4-4733-aafa-08ff971d5f7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:10.066624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-53802908-99b4-4733-aafa-08ff971d5f7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:10.073388 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53802908-99b4-4733-aafa-08ff971d5f7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:10.073831 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53802908-99b4-4733-aafa-08ff971d5f7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:10.075201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53802908-99b4-4733-aafa-08ff971d5f7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:10.075639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53802908-99b4-4733-aafa-08ff971d5f7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:10.174682 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-53802908-99b4-4733-aafa-08ff971d5f7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 5108 microversion: 2.20 time: 0.113137 Jan 25 03:43:10.175351 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 578/1079] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:10 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 5108 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:43:11.185559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0a4a41d2-9953-45a6-8974-da23b1dd2663 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:11.186540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0a4a41d2-9953-45a6-8974-da23b1dd2663 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:11.193590 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a4a41d2-9953-45a6-8974-da23b1dd2663 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:11.194033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a4a41d2-9953-45a6-8974-da23b1dd2663 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:11.194796 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a4a41d2-9953-45a6-8974-da23b1dd2663 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:11.195261 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a4a41d2-9953-45a6-8974-da23b1dd2663 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:11.285511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0a4a41d2-9953-45a6-8974-da23b1dd2663 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 15025 microversion: 2.20 time: 0.103803 Jan 25 03:43:11.286060 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 502/1080] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:11 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 15025 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:12.297265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5b373ef5-141e-4c49-ae55-7203ea1949ec tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:12.298261 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5b373ef5-141e-4c49-ae55-7203ea1949ec tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:12.305036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b373ef5-141e-4c49-ae55-7203ea1949ec tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:12.305481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b373ef5-141e-4c49-ae55-7203ea1949ec tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:12.306246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b373ef5-141e-4c49-ae55-7203ea1949ec tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:12.306715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b373ef5-141e-4c49-ae55-7203ea1949ec tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:12.398223 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5b373ef5-141e-4c49-ae55-7203ea1949ec tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 18498 microversion: 2.20 time: 0.104916 Jan 25 03:43:12.398893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 579/1081] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:12 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 18498 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:13.410071 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1eee41ec-750d-4640-ba52-25734b0195e2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:13.411214 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1eee41ec-750d-4640-ba52-25734b0195e2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:13.418844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1eee41ec-750d-4640-ba52-25734b0195e2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:13.419328 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1eee41ec-750d-4640-ba52-25734b0195e2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:13.420108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1eee41ec-750d-4640-ba52-25734b0195e2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:13.420552 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1eee41ec-750d-4640-ba52-25734b0195e2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:13.515402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1eee41ec-750d-4640-ba52-25734b0195e2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 19342 microversion: 2.20 time: 0.109247 Jan 25 03:43:13.516262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 503/1082] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:13 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 19342 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:14.526491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2f3799bf-be38-4c34-8a82-cdc6e727e94e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:14.528372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2f3799bf-be38-4c34-8a82-cdc6e727e94e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:14.535214 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f3799bf-be38-4c34-8a82-cdc6e727e94e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:14.535680 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f3799bf-be38-4c34-8a82-cdc6e727e94e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:14.536461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f3799bf-be38-4c34-8a82-cdc6e727e94e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:14.536904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2f3799bf-be38-4c34-8a82-cdc6e727e94e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:14.631549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2f3799bf-be38-4c34-8a82-cdc6e727e94e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 22494 microversion: 2.20 time: 0.108970 Jan 25 03:43:14.632179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 580/1083] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:14 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 22494 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:15.643792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-335597f7-9151-4bc7-b713-8b86e69a0285 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:15.644792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-335597f7-9151-4bc7-b713-8b86e69a0285 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:15.651642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-335597f7-9151-4bc7-b713-8b86e69a0285 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:15.652702 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-335597f7-9151-4bc7-b713-8b86e69a0285 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:15.653620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-335597f7-9151-4bc7-b713-8b86e69a0285 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:15.654063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-335597f7-9151-4bc7-b713-8b86e69a0285 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:15.749909 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-335597f7-9151-4bc7-b713-8b86e69a0285 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 23804 microversion: 2.20 time: 0.110099 Jan 25 03:43:15.750792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 504/1084] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:15 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 23804 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:16.762427 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-85082b50-c34d-4f43-a14e-684e180b6ee7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:16.763483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-85082b50-c34d-4f43-a14e-684e180b6ee7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:16.770310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85082b50-c34d-4f43-a14e-684e180b6ee7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:16.770768 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85082b50-c34d-4f43-a14e-684e180b6ee7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:16.771577 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85082b50-c34d-4f43-a14e-684e180b6ee7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:16.772012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85082b50-c34d-4f43-a14e-684e180b6ee7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:16.871927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-85082b50-c34d-4f43-a14e-684e180b6ee7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 25437 microversion: 2.20 time: 0.113377 Jan 25 03:43:16.872571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 581/1085] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:16 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 25437 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:17.883878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-21950ba7-5df3-43cb-960a-4c7246579836 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:17.884948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-21950ba7-5df3-43cb-960a-4c7246579836 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:17.891772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21950ba7-5df3-43cb-960a-4c7246579836 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:17.892193 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21950ba7-5df3-43cb-960a-4c7246579836 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:17.892953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21950ba7-5df3-43cb-960a-4c7246579836 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:17.893386 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21950ba7-5df3-43cb-960a-4c7246579836 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:17.994836 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-21950ba7-5df3-43cb-960a-4c7246579836 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 26854 microversion: 2.20 time: 0.114774 Jan 25 03:43:17.995523 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 505/1086] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:17 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 26854 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:19.007374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-03017320-b27d-4c7a-a160-d85c429c5ded tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:19.008369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-03017320-b27d-4c7a-a160-d85c429c5ded tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:19.015896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03017320-b27d-4c7a-a160-d85c429c5ded tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:19.016340 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03017320-b27d-4c7a-a160-d85c429c5ded tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:19.017106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03017320-b27d-4c7a-a160-d85c429c5ded tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:19.017538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03017320-b27d-4c7a-a160-d85c429c5ded tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:19.117519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-03017320-b27d-4c7a-a160-d85c429c5ded tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 27619 microversion: 2.20 time: 0.114102 Jan 25 03:43:19.118168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 582/1087] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:19 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 27619 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:20.129855 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7f0533e6-4efc-422e-adb1-188f3fb5946e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:20.130840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7f0533e6-4efc-422e-adb1-188f3fb5946e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:20.138517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f0533e6-4efc-422e-adb1-188f3fb5946e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:20.138996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f0533e6-4efc-422e-adb1-188f3fb5946e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:20.139792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f0533e6-4efc-422e-adb1-188f3fb5946e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:20.140222 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f0533e6-4efc-422e-adb1-188f3fb5946e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:20.237898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7f0533e6-4efc-422e-adb1-188f3fb5946e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 27929 microversion: 2.20 time: 0.111907 Jan 25 03:43:20.238798 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 506/1088] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:20 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 27929 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:21.249876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ba60d682-2dbf-4a50-be55-16a29e45d3ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:21.250772 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ba60d682-2dbf-4a50-be55-16a29e45d3ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:21.257647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba60d682-2dbf-4a50-be55-16a29e45d3ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:21.258085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba60d682-2dbf-4a50-be55-16a29e45d3ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:21.258847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba60d682-2dbf-4a50-be55-16a29e45d3ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:21.259307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ba60d682-2dbf-4a50-be55-16a29e45d3ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:21.349809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ba60d682-2dbf-4a50-be55-16a29e45d3ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.104495 Jan 25 03:43:21.350432 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 583/1089] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:21 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:22.362344 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c896adba-b69a-4f0f-97d4-4d41f7829ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:22.364382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c896adba-b69a-4f0f-97d4-4d41f7829ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:22.370472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c896adba-b69a-4f0f-97d4-4d41f7829ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:22.370921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c896adba-b69a-4f0f-97d4-4d41f7829ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:22.372286 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c896adba-b69a-4f0f-97d4-4d41f7829ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:22.372721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c896adba-b69a-4f0f-97d4-4d41f7829ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:22.459793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c896adba-b69a-4f0f-97d4-4d41f7829ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.101330 Jan 25 03:43:22.461163 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 507/1090] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:22 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:23.472471 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9324019b-0920-480d-92a7-2fead19e0ed6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:23.473467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9324019b-0920-480d-92a7-2fead19e0ed6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:23.480267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9324019b-0920-480d-92a7-2fead19e0ed6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:23.481356 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9324019b-0920-480d-92a7-2fead19e0ed6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:23.482136 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9324019b-0920-480d-92a7-2fead19e0ed6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:23.482572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9324019b-0920-480d-92a7-2fead19e0ed6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:23.565782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9324019b-0920-480d-92a7-2fead19e0ed6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.097279 Jan 25 03:43:23.566434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 584/1091] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:23 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:24.578470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-032262e2-e784-49f0-9ac6-8365ab574b58 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:24.579516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-032262e2-e784-49f0-9ac6-8365ab574b58 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:24.586343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032262e2-e784-49f0-9ac6-8365ab574b58 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:24.586799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032262e2-e784-49f0-9ac6-8365ab574b58 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:24.587618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032262e2-e784-49f0-9ac6-8365ab574b58 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:24.588057 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032262e2-e784-49f0-9ac6-8365ab574b58 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:24.671646 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-032262e2-e784-49f0-9ac6-8365ab574b58 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.097620 Jan 25 03:43:24.672273 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 508/1092] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:24 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:25.683757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9a6e9c76-a7a5-4dcf-b3fb-c2c92b79b3a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:25.684777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9a6e9c76-a7a5-4dcf-b3fb-c2c92b79b3a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:25.691870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9a6e9c76-a7a5-4dcf-b3fb-c2c92b79b3a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:25.692303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9a6e9c76-a7a5-4dcf-b3fb-c2c92b79b3a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:25.693066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9a6e9c76-a7a5-4dcf-b3fb-c2c92b79b3a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:25.693503 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9a6e9c76-a7a5-4dcf-b3fb-c2c92b79b3a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:25.779864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9a6e9c76-a7a5-4dcf-b3fb-c2c92b79b3a5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.100124 Jan 25 03:43:25.780531 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 585/1093] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:25 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:26.791989 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8d7884d1-636a-492e-9beb-014a22e04fe7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:26.793065 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8d7884d1-636a-492e-9beb-014a22e04fe7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:26.799981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d7884d1-636a-492e-9beb-014a22e04fe7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:26.800440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d7884d1-636a-492e-9beb-014a22e04fe7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:26.801221 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d7884d1-636a-492e-9beb-014a22e04fe7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:26.801665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d7884d1-636a-492e-9beb-014a22e04fe7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:26.887678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8d7884d1-636a-492e-9beb-014a22e04fe7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.098992 Jan 25 03:43:26.888334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 509/1094] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:26 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:27.900983 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c36b8ee9-2710-466e-9b82-26dbec3fe075 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:27.901986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c36b8ee9-2710-466e-9b82-26dbec3fe075 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:27.909033 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c36b8ee9-2710-466e-9b82-26dbec3fe075 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:27.909485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c36b8ee9-2710-466e-9b82-26dbec3fe075 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:27.910261 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c36b8ee9-2710-466e-9b82-26dbec3fe075 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:27.910695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c36b8ee9-2710-466e-9b82-26dbec3fe075 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:28.008742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c36b8ee9-2710-466e-9b82-26dbec3fe075 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.111792 Jan 25 03:43:28.009397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 586/1095] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:27 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:29.021742 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-54af1b7f-ee15-4165-9253-c18385894687 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:29.022719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-54af1b7f-ee15-4165-9253-c18385894687 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:29.029483 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54af1b7f-ee15-4165-9253-c18385894687 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:29.029921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54af1b7f-ee15-4165-9253-c18385894687 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:29.030683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54af1b7f-ee15-4165-9253-c18385894687 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:29.031135 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54af1b7f-ee15-4165-9253-c18385894687 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:29.122616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-54af1b7f-ee15-4165-9253-c18385894687 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.103884 Jan 25 03:43:29.123277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 510/1096] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:29 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:30.134632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-96f7e4c4-932a-4330-97ef-10017566b5f4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:30.135692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-96f7e4c4-932a-4330-97ef-10017566b5f4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:30.143445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-96f7e4c4-932a-4330-97ef-10017566b5f4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:30.143903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-96f7e4c4-932a-4330-97ef-10017566b5f4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:30.144681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-96f7e4c4-932a-4330-97ef-10017566b5f4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:30.145138 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-96f7e4c4-932a-4330-97ef-10017566b5f4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:30.237644 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-96f7e4c4-932a-4330-97ef-10017566b5f4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.106901 Jan 25 03:43:30.238279 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 587/1097] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:30 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:31.250445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e3108569-e66e-4b8a-a714-5203590c1f66 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:31.251379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e3108569-e66e-4b8a-a714-5203590c1f66 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:31.258317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3108569-e66e-4b8a-a714-5203590c1f66 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:31.258767 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3108569-e66e-4b8a-a714-5203590c1f66 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:31.259578 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3108569-e66e-4b8a-a714-5203590c1f66 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:31.260008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e3108569-e66e-4b8a-a714-5203590c1f66 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:31.347534 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e3108569-e66e-4b8a-a714-5203590c1f66 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.101657 Jan 25 03:43:31.348483 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 511/1098] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:31 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:32.360359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5ba38211-1d07-490e-8952-f9ad22aa2c27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:32.361445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5ba38211-1d07-490e-8952-f9ad22aa2c27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:32.368880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ba38211-1d07-490e-8952-f9ad22aa2c27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:32.369410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ba38211-1d07-490e-8952-f9ad22aa2c27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:32.370168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ba38211-1d07-490e-8952-f9ad22aa2c27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:32.370637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ba38211-1d07-490e-8952-f9ad22aa2c27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:32.467308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5ba38211-1d07-490e-8952-f9ad22aa2c27 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.111733 Jan 25 03:43:32.467953 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 588/1099] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:32 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:33.478978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5d10a068-5489-4aa7-b0e5-2bef94cc2574 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:33.479992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5d10a068-5489-4aa7-b0e5-2bef94cc2574 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:33.486952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d10a068-5489-4aa7-b0e5-2bef94cc2574 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:33.487422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d10a068-5489-4aa7-b0e5-2bef94cc2574 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:33.488219 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d10a068-5489-4aa7-b0e5-2bef94cc2574 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:33.488647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d10a068-5489-4aa7-b0e5-2bef94cc2574 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:33.571391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5d10a068-5489-4aa7-b0e5-2bef94cc2574 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28225 microversion: 2.20 time: 0.096419 Jan 25 03:43:33.572011 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 512/1100] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:33 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:34.584367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f620bc7d-ceaf-4b42-874d-701912b1e94d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:34.585365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f620bc7d-ceaf-4b42-874d-701912b1e94d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:34.592531 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f620bc7d-ceaf-4b42-874d-701912b1e94d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:34.592986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f620bc7d-ceaf-4b42-874d-701912b1e94d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:34.593767 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f620bc7d-ceaf-4b42-874d-701912b1e94d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:34.594205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f620bc7d-ceaf-4b42-874d-701912b1e94d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:34.694627 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f620bc7d-ceaf-4b42-874d-701912b1e94d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28516 microversion: 2.20 time: 0.114250 Jan 25 03:43:34.695334 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 589/1101] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:34 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28516 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:35.706513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a166856f-6bbb-4fad-8104-5d770eb00722 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:35.707592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a166856f-6bbb-4fad-8104-5d770eb00722 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:35.714483 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a166856f-6bbb-4fad-8104-5d770eb00722 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:35.714933 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a166856f-6bbb-4fad-8104-5d770eb00722 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:35.715750 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a166856f-6bbb-4fad-8104-5d770eb00722 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:35.716188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a166856f-6bbb-4fad-8104-5d770eb00722 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:35.802405 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a166856f-6bbb-4fad-8104-5d770eb00722 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28516 microversion: 2.20 time: 0.099878 Jan 25 03:43:35.803041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 513/1102] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:35 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28516 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:36.814723 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a231c275-5560-4ebd-a762-754e12fdae2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:36.815741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a231c275-5560-4ebd-a762-754e12fdae2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:36.822476 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a231c275-5560-4ebd-a762-754e12fdae2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:36.822925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a231c275-5560-4ebd-a762-754e12fdae2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:36.823754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a231c275-5560-4ebd-a762-754e12fdae2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:36.824184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a231c275-5560-4ebd-a762-754e12fdae2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:36.921862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a231c275-5560-4ebd-a762-754e12fdae2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.111342 Jan 25 03:43:36.922509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 590/1103] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:36 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:37.933732 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-817216ee-85fb-47a8-9f74-5d3cd489b364 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:37.939860 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-817216ee-85fb-47a8-9f74-5d3cd489b364 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:37.941961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-817216ee-85fb-47a8-9f74-5d3cd489b364 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:37.942418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-817216ee-85fb-47a8-9f74-5d3cd489b364 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:37.943245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-817216ee-85fb-47a8-9f74-5d3cd489b364 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:37.943688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-817216ee-85fb-47a8-9f74-5d3cd489b364 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:38.029048 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-817216ee-85fb-47a8-9f74-5d3cd489b364 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.099286 Jan 25 03:43:38.031642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 514/1104] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:37 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:39.041680 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-eca65a0f-b79c-4cac-955b-172039b80f69 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:39.042716 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-eca65a0f-b79c-4cac-955b-172039b80f69 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:39.049683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eca65a0f-b79c-4cac-955b-172039b80f69 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:39.050142 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eca65a0f-b79c-4cac-955b-172039b80f69 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:39.050922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eca65a0f-b79c-4cac-955b-172039b80f69 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:39.051399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eca65a0f-b79c-4cac-955b-172039b80f69 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:39.148686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-eca65a0f-b79c-4cac-955b-172039b80f69 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.110932 Jan 25 03:43:39.149320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 591/1105] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:39 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:40.160330 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-395892cc-4ebc-462a-acb0-8c52370e15b5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:40.161383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-395892cc-4ebc-462a-acb0-8c52370e15b5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:40.168248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-395892cc-4ebc-462a-acb0-8c52370e15b5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:40.169221 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-395892cc-4ebc-462a-acb0-8c52370e15b5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:40.170006 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-395892cc-4ebc-462a-acb0-8c52370e15b5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:40.170449 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-395892cc-4ebc-462a-acb0-8c52370e15b5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:40.272791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-395892cc-4ebc-462a-acb0-8c52370e15b5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.116400 Jan 25 03:43:40.273677 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 515/1106] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:40 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:41.285644 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-68a49086-bfeb-44cb-8cc0-de6f041e338c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:41.286558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-68a49086-bfeb-44cb-8cc0-de6f041e338c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:41.293383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68a49086-bfeb-44cb-8cc0-de6f041e338c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:41.294658 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68a49086-bfeb-44cb-8cc0-de6f041e338c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:41.295676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68a49086-bfeb-44cb-8cc0-de6f041e338c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:41.296116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-68a49086-bfeb-44cb-8cc0-de6f041e338c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:41.388483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-68a49086-bfeb-44cb-8cc0-de6f041e338c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.106763 Jan 25 03:43:41.389145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 592/1107] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:41 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:42.400418 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-65be3118-64c6-4108-bdc4-a5bb546a2387 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:42.401393 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-65be3118-64c6-4108-bdc4-a5bb546a2387 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:42.408939 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65be3118-64c6-4108-bdc4-a5bb546a2387 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:42.409369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65be3118-64c6-4108-bdc4-a5bb546a2387 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:42.410163 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65be3118-64c6-4108-bdc4-a5bb546a2387 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:42.410595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65be3118-64c6-4108-bdc4-a5bb546a2387 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:42.494257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-65be3118-64c6-4108-bdc4-a5bb546a2387 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.097704 Jan 25 03:43:42.494897 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 516/1108] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:42 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:43.507027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0025279a-e39b-4f07-8aea-584055d80b21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:43.508055 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0025279a-e39b-4f07-8aea-584055d80b21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:43.515631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0025279a-e39b-4f07-8aea-584055d80b21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:43.516117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0025279a-e39b-4f07-8aea-584055d80b21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:43.516904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0025279a-e39b-4f07-8aea-584055d80b21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:43.517343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0025279a-e39b-4f07-8aea-584055d80b21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:43.606647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0025279a-e39b-4f07-8aea-584055d80b21 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.103410 Jan 25 03:43:43.607363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 593/1109] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:43 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:44.619153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0034f497-1ea7-4486-a860-49ce5935c415 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:44.620058 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0034f497-1ea7-4486-a860-49ce5935c415 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:44.626835 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0034f497-1ea7-4486-a860-49ce5935c415 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:44.627308 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0034f497-1ea7-4486-a860-49ce5935c415 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:44.628086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0034f497-1ea7-4486-a860-49ce5935c415 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:44.628521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0034f497-1ea7-4486-a860-49ce5935c415 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:44.713324 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0034f497-1ea7-4486-a860-49ce5935c415 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.098247 Jan 25 03:43:44.714309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 517/1110] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:44 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:45.725962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-48c8ba28-026a-4f6b-b4fa-efead17e299e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:45.727000 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-48c8ba28-026a-4f6b-b4fa-efead17e299e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:45.734573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c8ba28-026a-4f6b-b4fa-efead17e299e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:45.735026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c8ba28-026a-4f6b-b4fa-efead17e299e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:45.735829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c8ba28-026a-4f6b-b4fa-efead17e299e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:45.736283 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-48c8ba28-026a-4f6b-b4fa-efead17e299e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:45.829851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-48c8ba28-026a-4f6b-b4fa-efead17e299e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.107749 Jan 25 03:43:45.830511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 594/1111] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:45 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:46.842393 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b9c71dbc-036a-47a4-ac96-e27bd24aab40 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:46.843433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b9c71dbc-036a-47a4-ac96-e27bd24aab40 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:46.850383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9c71dbc-036a-47a4-ac96-e27bd24aab40 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:46.850842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9c71dbc-036a-47a4-ac96-e27bd24aab40 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:46.851654 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9c71dbc-036a-47a4-ac96-e27bd24aab40 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:46.852096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b9c71dbc-036a-47a4-ac96-e27bd24aab40 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:46.943561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b9c71dbc-036a-47a4-ac96-e27bd24aab40 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.105671 Jan 25 03:43:46.944205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 518/1112] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:46 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:47.958614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5b357095-dd25-40df-b2d0-7ba8a51d117a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:47.958614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5b357095-dd25-40df-b2d0-7ba8a51d117a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:47.964037 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b357095-dd25-40df-b2d0-7ba8a51d117a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:47.964494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b357095-dd25-40df-b2d0-7ba8a51d117a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:47.965907 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b357095-dd25-40df-b2d0-7ba8a51d117a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:47.966365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b357095-dd25-40df-b2d0-7ba8a51d117a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:48.063518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5b357095-dd25-40df-b2d0-7ba8a51d117a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.111607 Jan 25 03:43:48.064159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 595/1113] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:47 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:49.075202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6be9d9d5-6aff-45b5-85bd-2412aee2cc12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:49.076200 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6be9d9d5-6aff-45b5-85bd-2412aee2cc12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:49.083023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6be9d9d5-6aff-45b5-85bd-2412aee2cc12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:49.083502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6be9d9d5-6aff-45b5-85bd-2412aee2cc12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:49.084314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6be9d9d5-6aff-45b5-85bd-2412aee2cc12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:49.084746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6be9d9d5-6aff-45b5-85bd-2412aee2cc12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:49.175468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6be9d9d5-6aff-45b5-85bd-2412aee2cc12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.104288 Jan 25 03:43:49.176378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 519/1114] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:49 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:50.188477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c30a24bc-589d-45ea-8845-5ad62edf81db tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:50.189580 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c30a24bc-589d-45ea-8845-5ad62edf81db tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:50.196385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c30a24bc-589d-45ea-8845-5ad62edf81db tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:50.196842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c30a24bc-589d-45ea-8845-5ad62edf81db tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:50.197625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c30a24bc-589d-45ea-8845-5ad62edf81db tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:50.198075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c30a24bc-589d-45ea-8845-5ad62edf81db tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:50.297080 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c30a24bc-589d-45ea-8845-5ad62edf81db tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.113258 Jan 25 03:43:50.300892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 596/1115] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:50 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:51.309190 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-32493aeb-959f-40c8-8940-9505958285e8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:51.310196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-32493aeb-959f-40c8-8940-9505958285e8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:51.317232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-32493aeb-959f-40c8-8940-9505958285e8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:51.317680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-32493aeb-959f-40c8-8940-9505958285e8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:51.318445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-32493aeb-959f-40c8-8940-9505958285e8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:51.318879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-32493aeb-959f-40c8-8940-9505958285e8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:51.414371 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-32493aeb-959f-40c8-8940-9505958285e8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.109119 Jan 25 03:43:51.415020 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 520/1116] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:51 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:52.426270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d3b11222-337d-466e-86c9-f3222c03ad7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:52.427326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d3b11222-337d-466e-86c9-f3222c03ad7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:52.434842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3b11222-337d-466e-86c9-f3222c03ad7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:52.435337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3b11222-337d-466e-86c9-f3222c03ad7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:52.436124 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3b11222-337d-466e-86c9-f3222c03ad7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:52.436571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d3b11222-337d-466e-86c9-f3222c03ad7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:52.519577 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d3b11222-337d-466e-86c9-f3222c03ad7b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.097247 Jan 25 03:43:52.520284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 597/1117] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:52 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:53.532516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-de3e6389-77c1-41cd-b552-e1d4f027e3e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:53.533522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-de3e6389-77c1-41cd-b552-e1d4f027e3e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:53.540390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-de3e6389-77c1-41cd-b552-e1d4f027e3e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:53.540847 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-de3e6389-77c1-41cd-b552-e1d4f027e3e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:53.541628 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-de3e6389-77c1-41cd-b552-e1d4f027e3e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:53.542069 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-de3e6389-77c1-41cd-b552-e1d4f027e3e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:53.629037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-de3e6389-77c1-41cd-b552-e1d4f027e3e1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.101228 Jan 25 03:43:53.629607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 521/1118] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:53 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:54.641379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-941377cb-53b9-4535-8457-ce4f3f861d77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:54.642434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-941377cb-53b9-4535-8457-ce4f3f861d77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:54.649286 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941377cb-53b9-4535-8457-ce4f3f861d77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:54.649738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941377cb-53b9-4535-8457-ce4f3f861d77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:54.650514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941377cb-53b9-4535-8457-ce4f3f861d77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:54.650957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-941377cb-53b9-4535-8457-ce4f3f861d77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:54.739915 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-941377cb-53b9-4535-8457-ce4f3f861d77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.102644 Jan 25 03:43:54.740589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 598/1119] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:54 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:55.004024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:43:55.004024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:43:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 (ip 10.222.0.115) !!! Jan 25 03:43:55.067646 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:43:55.068237 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:55.074278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:55.075277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:55.076057 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:55.076499 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:55.100649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:43:55.377024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-59f69ab8-628c-4ae6-9336-ffa90f543af5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "DELETE /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 204 len: 0 microversion: 2.1 time: 0.467753 Jan 25 03:43:55.377618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 522/1120] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:43:54 2022] DELETE /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:43:55.387725 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:43:55.388601 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:55.395573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:55.396035 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:55.396820 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:55.397267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:55.532339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:43:55.539712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-85a0d40f-0d9b-46cb-8df5-d939721da289 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1578 microversion: 2.1 time: 0.157501 Jan 25 03:43:55.540276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 599/1121] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:43:55 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:43:55.752926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3b8db18a-62bc-4dcb-b7ac-431f538414b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:55.753926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3b8db18a-62bc-4dcb-b7ac-431f538414b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:55.760216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b8db18a-62bc-4dcb-b7ac-431f538414b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:55.760663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b8db18a-62bc-4dcb-b7ac-431f538414b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:55.761436 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b8db18a-62bc-4dcb-b7ac-431f538414b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:55.761872 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b8db18a-62bc-4dcb-b7ac-431f538414b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:55.849897 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3b8db18a-62bc-4dcb-b7ac-431f538414b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.100887 Jan 25 03:43:55.850535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 523/1122] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:55 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:56.556860 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:43:56.557481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:56.564091 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:56.564546 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:56.565326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:56.565772 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:56.697340 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:43:56.704917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7eb112cf-5a69-4154-8335-abaa1b1eef83 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1578 microversion: 2.1 time: 0.151763 Jan 25 03:43:56.705497 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 600/1123] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:43:56 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:56.862746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-670a4f14-c345-4a95-892d-3596dc2b44ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:56.863776 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-670a4f14-c345-4a95-892d-3596dc2b44ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:56.870620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-670a4f14-c345-4a95-892d-3596dc2b44ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:56.871078 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-670a4f14-c345-4a95-892d-3596dc2b44ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:56.872592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-670a4f14-c345-4a95-892d-3596dc2b44ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:56.873036 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-670a4f14-c345-4a95-892d-3596dc2b44ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:56.976157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-670a4f14-c345-4a95-892d-3596dc2b44ac tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.117429 Jan 25 03:43:56.976944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 524/1124] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:56 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:57.493562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-feb58ef5-850d-4bb4-a759-c9a51f1d1a8e tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:57.494504 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-feb58ef5-850d-4bb4-a759-c9a51f1d1a8e tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:57.500948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-feb58ef5-850d-4bb4-a759-c9a51f1d1a8e tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.501406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-feb58ef5-850d-4bb4-a759-c9a51f1d1a8e tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:57.502195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-feb58ef5-850d-4bb4-a759-c9a51f1d1a8e tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.502636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-feb58ef5-850d-4bb4-a759-c9a51f1d1a8e tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:57.721536 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:43:57.722268 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:57.729150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.729598 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:57.730369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.730801 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:57.735033 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-feb58ef5-850d-4bb4-a759-c9a51f1d1a8e tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/action" status: 202 len: 0 microversion: 2.1 time: 0.244950 Jan 25 03:43:57.737139 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 601/1125] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:43:57 2022] POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:43:57.744776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:43:57.745781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:57.755920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.756706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:57.757581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.758159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:57.907672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:43:57.915657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d25404fc-fb2e-4ceb-bd58-3295a2e092a7 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1754 microversion: 2.1 time: 0.175310 Jan 25 03:43:57.916251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 602/1126] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:43:57 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:43:57.988311 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5b5b37c2-68a5-44ad-8166-b4f08e0c6e99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:57.989324 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5b5b37c2-68a5-44ad-8166-b4f08e0c6e99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:57.995307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b5b37c2-68a5-44ad-8166-b4f08e0c6e99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.995896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b5b37c2-68a5-44ad-8166-b4f08e0c6e99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:57.996693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b5b37c2-68a5-44ad-8166-b4f08e0c6e99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:57.997193 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b5b37c2-68a5-44ad-8166-b4f08e0c6e99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:58.022367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:43:58.031193 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e5171503-c734-4b4b-9f72-de01b1518797 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1578 microversion: 2.1 time: 0.313688 Jan 25 03:43:58.031771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 525/1127] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:43:57 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1578 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:43:58.080444 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5b5b37c2-68a5-44ad-8166-b4f08e0c6e99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.095892 Jan 25 03:43:58.084347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 603/1128] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:57 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:43:58.933730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:43:58.934995 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:58.942640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:58.943128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:58.943933 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:58.944367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:59.049758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:43:59.050490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:59.057300 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:59.057757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:59.058554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:59.059019 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:59.145581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:43:59.156431 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e4b8efb7-f1b5-40bd-9798-a4911a39a26d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1512 microversion: 2.1 time: 0.110085 Jan 25 03:43:59.157077 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 604/1129] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:43:59 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1512 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:43:59.163865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6ac4715d-5860-4aa5-a7bd-e552213dd265 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:59.166771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6ac4715d-5860-4aa5-a7bd-e552213dd265 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:43:59.174434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6ac4715d-5860-4aa5-a7bd-e552213dd265 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:59.175172 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6ac4715d-5860-4aa5-a7bd-e552213dd265 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:59.176065 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6ac4715d-5860-4aa5-a7bd-e552213dd265 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:59.176522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6ac4715d-5860-4aa5-a7bd-e552213dd265 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:59.193761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:43:59.204307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-25614e03-3c24-4efb-a5a5-7935b56c4455 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1754 microversion: 2.1 time: 0.274226 Jan 25 03:43:59.204906 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 526/1130] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:43:58 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1754 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:43:59.209825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-aa12d676-b955-432e-a20f-97b538f1dc52 req-94247195-cc97-446e-8b0c-a2764de17edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac7ea524-7a77-478b-9894-556c2be34d87", "name": "network-vif-deleted", "tag": "185f7b43-0027-48fd-9809-01daf6b8ce49"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:43:59.211494 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:43:59.211494 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:43:59.227357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-aa12d676-b955-432e-a20f-97b538f1dc52 req-94247195-cc97-446e-8b0c-a2764de17edb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:43:59.227951 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-aa12d676-b955-432e-a20f-97b538f1dc52 req-94247195-cc97-446e-8b0c-a2764de17edb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:43:59.243154 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-aa12d676-b955-432e-a20f-97b538f1dc52 req-94247195-cc97-446e-8b0c-a2764de17edb service nova] Creating event network-vif-deleted:185f7b43-0027-48fd-9809-01daf6b8ce49 for instance ac7ea524-7a77-478b-9894-556c2be34d87 on hv-cinder-81901 Jan 25 03:43:59.249588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-aa12d676-b955-432e-a20f-97b538f1dc52 req-94247195-cc97-446e-8b0c-a2764de17edb service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043088 Jan 25 03:43:59.250133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 527/1131] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:43:59.304948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6ac4715d-5860-4aa5-a7bd-e552213dd265 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.146162 Jan 25 03:43:59.305610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 605/1132] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:43:59 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:00.174410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:00.175345 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:00.181713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:00.182424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:00.183371 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:00.183891 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:00.219101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:00.220140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:00.220740 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lazy-loading 'fault' on Instance uuid ac7ea524-7a77-478b-9894-556c2be34d87 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:44:00.222064 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:00.223454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:00.232891 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:00.233729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:00.234626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:00.235090 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:00.263725 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:00.271662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-dfbbf95a-93fa-4826-b6f1-b26f111382f8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 200 len: 1233 microversion: 2.1 time: 0.101987 Jan 25 03:44:00.273674 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 528/1133] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:00 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 1233 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:00.317610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d956c803-50dc-4ed2-b8e9-a1b9ab49b803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:00.318696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d956c803-50dc-4ed2-b8e9-a1b9ab49b803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:00.325774 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d956c803-50dc-4ed2-b8e9-a1b9ab49b803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:00.326327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d956c803-50dc-4ed2-b8e9-a1b9ab49b803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:00.327286 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d956c803-50dc-4ed2-b8e9-a1b9ab49b803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:00.327799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d956c803-50dc-4ed2-b8e9-a1b9ab49b803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:00.424334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d956c803-50dc-4ed2-b8e9-a1b9ab49b803 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.110265 Jan 25 03:44:00.429818 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 529/1134] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:00 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:00.601356 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:00.610075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6d95fd60-b6e0-47c2-a80e-8aaf209ab858 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.392017 Jan 25 03:44:00.610655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 606/1135] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:00 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:01.290201 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:01.290815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:01.299332 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.299846 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.300991 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.301760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.326538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] HTTP exception thrown: Instance ac7ea524-7a77-478b-9894-556c2be34d87 could not be found. Jan 25 03:44:01.327172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Returning 404 to user: Instance ac7ea524-7a77-478b-9894-556c2be34d87 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:44:01.328003 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-26272085-6ecc-4317-8907-ab86376453cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 404 len: 111 microversion: 2.1 time: 0.041981 Jan 25 03:44:01.328552 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 530/1136] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:01 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:44:01.376495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1070051153", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1048410455", "security_groups": [{"name": "tempest-secgroup-smoke-63611146"}], "block_device_mapping_v2": [{"uuid": "65a000be-6abc-4491-abc3-e1d420be4ce9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ff74d41-8997-4f13-a353-f1aafd7e012e"}]}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:01.436405 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1cdd3513-d2a1-47cc-aea4-10517eacf2b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:01.437593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1cdd3513-d2a1-47cc-aea4-10517eacf2b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:01.443908 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1cdd3513-d2a1-47cc-aea4-10517eacf2b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.444358 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1cdd3513-d2a1-47cc-aea4-10517eacf2b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.445130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1cdd3513-d2a1-47cc-aea4-10517eacf2b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.445562 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1cdd3513-d2a1-47cc-aea4-10517eacf2b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.488145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] validate_networks() for [('0ff74d41-8997-4f13-a353-f1aafd7e012e', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:44:01.540639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1cdd3513-d2a1-47cc-aea4-10517eacf2b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.108121 Jan 25 03:44:01.541488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 531/1137] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:01 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:01.627531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:01.628232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:01.635155 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.635614 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.636401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.636843 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.781425 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:01.789328 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e66fec4c-3aca-4db3-baa1-377be224ad8a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.165845 Jan 25 03:44:01.789910 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 532/1138] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:01 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:01.850592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:44:01.851047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:44:01.851539 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:44:01.851959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:44:01.852380 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:44:01.860955 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.861415 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.862241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:01.862686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:01.878664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for project 0fe72d0d8d144438a671aac4e939c693. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:44:01.882512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for user 792e6b0c7c4946ed88fbc454b1779485 and project 0fe72d0d8d144438a671aac4e939c693. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:44:01.946159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:44:01.948475 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65a000be-6abc-4491-abc3-e1d420be4ce9',volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:44:02.338619 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d2bc7664-ee0c-4be0-9d19-950d77cbc495 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.966722 Jan 25 03:44:02.339295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 607/1139] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:44:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:44:02.348841 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b47dd6e7-f9a1-49c9-99eb-f9b879e159e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:02.349445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b47dd6e7-f9a1-49c9-99eb-f9b879e159e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:02.406363 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b47dd6e7-f9a1-49c9-99eb-f9b879e159e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:02.413533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b47dd6e7-f9a1-49c9-99eb-f9b879e159e4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1098 microversion: 2.1 time: 0.068327 Jan 25 03:44:02.414089 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 533/1140] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:02 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1098 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:02.552900 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-220e8d25-e7b5-4ac6-ba1d-252f41fbed61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:02.553902 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-220e8d25-e7b5-4ac6-ba1d-252f41fbed61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:02.560495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-220e8d25-e7b5-4ac6-ba1d-252f41fbed61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:02.560947 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-220e8d25-e7b5-4ac6-ba1d-252f41fbed61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:02.561722 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-220e8d25-e7b5-4ac6-ba1d-252f41fbed61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:02.562416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-220e8d25-e7b5-4ac6-ba1d-252f41fbed61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:02.650112 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-220e8d25-e7b5-4ac6-ba1d-252f41fbed61 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.100899 Jan 25 03:44:02.650793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 608/1141] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:02 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:02.806382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:02.807004 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:02.814228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:02.814733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:02.815572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:02.816016 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:02.958308 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:02.967352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ab523305-98e8-48c5-8678-185f21e1fbde tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.164683 Jan 25 03:44:02.967936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 534/1142] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:02 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:03.431098 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:03.431835 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:03.439120 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:03.439585 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:03.440374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:03.440819 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:03.501285 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:03.509005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d5ef79de-9648-4931-ae57-74e632d5ad8e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1140 microversion: 2.1 time: 0.082309 Jan 25 03:44:03.509580 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 609/1143] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:03 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1140 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:03.661477 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fde95d8d-20d3-44ea-9eda-be18eb1a84b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:03.662493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fde95d8d-20d3-44ea-9eda-be18eb1a84b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:03.669022 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fde95d8d-20d3-44ea-9eda-be18eb1a84b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:03.669469 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fde95d8d-20d3-44ea-9eda-be18eb1a84b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:03.670244 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fde95d8d-20d3-44ea-9eda-be18eb1a84b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:03.670683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fde95d8d-20d3-44ea-9eda-be18eb1a84b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:03.757551 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fde95d8d-20d3-44ea-9eda-be18eb1a84b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.099455 Jan 25 03:44:03.761176 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 535/1144] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:03 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:03.984796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:03.985401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:03.992056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:03.992537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:03.993357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:03.993806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:04.141549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:04.149368 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bdd40e0f-e6e7-4cdf-8606-2d70f7c14e3a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.168889 Jan 25 03:44:04.149941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 610/1145] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:03 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:04.526137 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:04.526873 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:04.534075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:04.534615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:04.535465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:04.535922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:04.613196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:04.620877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-47101d78-d02a-43cb-a5db-ef7e105c1cd4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1214 microversion: 2.1 time: 0.098842 Jan 25 03:44:04.630716 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 536/1146] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:04 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:04.769355 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-032dc6a6-bd68-45f5-b61f-5c852714cd8b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:04.770380 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-032dc6a6-bd68-45f5-b61f-5c852714cd8b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:04.776870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-032dc6a6-bd68-45f5-b61f-5c852714cd8b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:04.777407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-032dc6a6-bd68-45f5-b61f-5c852714cd8b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:04.779244 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-032dc6a6-bd68-45f5-b61f-5c852714cd8b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:04.779694 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-032dc6a6-bd68-45f5-b61f-5c852714cd8b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:04.861992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-032dc6a6-bd68-45f5-b61f-5c852714cd8b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.096158 Jan 25 03:44:04.865854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 611/1147] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:04 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:05.167756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:05.168971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:05.175656 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:05.179223 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:05.181692 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:05.182140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:05.479582 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:05.487442 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-00bb63b8-e0b7-4ea1-8a49-fe23773a4e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.323906 Jan 25 03:44:05.488013 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 537/1148] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:05 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:05.639119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:05.639794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:05.646515 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:05.646964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:05.647754 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:05.648195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:05.795168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:05.805350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-85ec1a29-b973-4f2d-9dee-dcbe9bbd11fc tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1280 microversion: 2.1 time: 0.170785 Jan 25 03:44:05.805944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 612/1149] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:05 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:05.874576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c2dba58e-a442-4380-b037-da0ba4aebe6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:05.875527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c2dba58e-a442-4380-b037-da0ba4aebe6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:05.882167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c2dba58e-a442-4380-b037-da0ba4aebe6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:05.882932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c2dba58e-a442-4380-b037-da0ba4aebe6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:05.883964 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c2dba58e-a442-4380-b037-da0ba4aebe6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:05.884555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c2dba58e-a442-4380-b037-da0ba4aebe6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:05.978867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c2dba58e-a442-4380-b037-da0ba4aebe6f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.108914 Jan 25 03:44:05.983374 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 538/1150] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:05 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:06.023410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-46a7d6ee-361d-4421-83c6-cc0704d61def req-4d98bebb-38a3-4eac-965a-1a7d56b4eb33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6fc152-dc5c-493a-9933-95f0408e1caa", "tag": "b92e2cb6-c6e1-4723-843b-37dd1c830bbb"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:06.025440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:44:06.025440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:44:06.033966 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-46a7d6ee-361d-4421-83c6-cc0704d61def req-4d98bebb-38a3-4eac-965a-1a7d56b4eb33 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:06.034399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-46a7d6ee-361d-4421-83c6-cc0704d61def req-4d98bebb-38a3-4eac-965a-1a7d56b4eb33 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:06.053402 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-46a7d6ee-361d-4421-83c6-cc0704d61def req-4d98bebb-38a3-4eac-965a-1a7d56b4eb33 service nova] Creating event network-changed:b92e2cb6-c6e1-4723-843b-37dd1c830bbb for instance 7c6fc152-dc5c-493a-9933-95f0408e1caa on hv-cinder-81901 Jan 25 03:44:06.058404 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-46a7d6ee-361d-4421-83c6-cc0704d61def req-4d98bebb-38a3-4eac-965a-1a7d56b4eb33 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042549 Jan 25 03:44:06.059008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 613/1151] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:44:06.504959 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:06.505660 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:06.512974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:06.513423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:06.514202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:06.514639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:06.768794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:06.777056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5eeb13b0-41c9-4c74-9b49-ca45a17d4e12 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.276171 Jan 25 03:44:06.778351 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 539/1152] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:06 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:06.823179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:06.823888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:06.830316 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:06.830779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:06.831587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:06.832032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:06.974437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:06.984109 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b69310df-0f3f-42cc-bdb3-cd7a07fd61a0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.165106 Jan 25 03:44:06.984666 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 614/1153] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:06 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:06.992056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c82b7b65-7cef-4d2e-87ec-8afbb71b3770 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:06.993747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c82b7b65-7cef-4d2e-87ec-8afbb71b3770 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:07.000072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c82b7b65-7cef-4d2e-87ec-8afbb71b3770 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:07.000530 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c82b7b65-7cef-4d2e-87ec-8afbb71b3770 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:07.001401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c82b7b65-7cef-4d2e-87ec-8afbb71b3770 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:07.001848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c82b7b65-7cef-4d2e-87ec-8afbb71b3770 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:07.089438 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c82b7b65-7cef-4d2e-87ec-8afbb71b3770 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 28684 microversion: 2.20 time: 0.101902 Jan 25 03:44:07.090673 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 540/1154] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:06 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 28684 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:07.795075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:07.795690 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:07.801988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:07.802439 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:07.803238 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:07.803676 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:07.945591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:07.953694 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e016c685-a58a-4d3b-934a-65441a90ed01 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.162857 Jan 25 03:44:07.954263 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 615/1155] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:07 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:08.002576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:08.003340 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:08.011618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:08.011618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:08.011618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:08.011929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:08.101638 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-13b19121-9bb9-40c4-8fd8-5d76abb613e0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:08.102773 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-13b19121-9bb9-40c4-8fd8-5d76abb613e0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:08.109292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13b19121-9bb9-40c4-8fd8-5d76abb613e0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:08.109757 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13b19121-9bb9-40c4-8fd8-5d76abb613e0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:08.110550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13b19121-9bb9-40c4-8fd8-5d76abb613e0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:08.110994 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-13b19121-9bb9-40c4-8fd8-5d76abb613e0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:08.145412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:08.153269 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ba7e9fa9-dc50-4726-9246-40d91f75d62b tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.154154 Jan 25 03:44:08.153842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 541/1156] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:07 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:08.204237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-13b19121-9bb9-40c4-8fd8-5d76abb613e0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 30616 microversion: 2.20 time: 0.106049 Jan 25 03:44:08.208125 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 616/1157] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:08 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 30616 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:08.976533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:08.977211 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:08.984445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:08.984887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:08.985661 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:08.986089 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:09.131220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:09.139044 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-09d12b80-3336-45c9-9711-4f08382c3d86 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.166210 Jan 25 03:44:09.139626 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 542/1158] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:08 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:09.170514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:09.171251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:09.178068 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:09.178526 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:09.179338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:09.179784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:09.216600 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1880620b-63d7-49e5-a0da-c3650fe3b4ba tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:09.217512 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1880620b-63d7-49e5-a0da-c3650fe3b4ba tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:09.223459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1880620b-63d7-49e5-a0da-c3650fe3b4ba tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:09.223914 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1880620b-63d7-49e5-a0da-c3650fe3b4ba tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:09.224698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1880620b-63d7-49e5-a0da-c3650fe3b4ba tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:09.225131 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1880620b-63d7-49e5-a0da-c3650fe3b4ba tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:09.309377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:09.317373 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d6129ee3-ce75-40ee-8e92-c2af59a93e34 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.151462 Jan 25 03:44:09.317935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 617/1159] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:09 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:09.325978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1880620b-63d7-49e5-a0da-c3650fe3b4ba tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 32639 microversion: 2.20 time: 0.113486 Jan 25 03:44:09.327041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 543/1160] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:09 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 32639 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:10.155896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:10.156508 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:10.162762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:10.163256 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:10.164042 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:10.164480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:10.310929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:10.319001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4e6e574e-6e0c-4d94-934e-ae9d4b1ce2f5 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1759 microversion: 2.1 time: 0.166842 Jan 25 03:44:10.319596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 618/1161] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:10 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:10.334065 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:10.337605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:10.337747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3b1977c1-e23d-40b4-a49f-863ba8df8cb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:10.337747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3b1977c1-e23d-40b4-a49f-863ba8df8cb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:10.341504 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:10.341956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:10.342739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:10.343090 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b1977c1-e23d-40b4-a49f-863ba8df8cb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:10.343218 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:10.343557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b1977c1-e23d-40b4-a49f-863ba8df8cb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:10.344347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b1977c1-e23d-40b4-a49f-863ba8df8cb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:10.344788 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3b1977c1-e23d-40b4-a49f-863ba8df8cb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:10.440326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3b1977c1-e23d-40b4-a49f-863ba8df8cb8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 33515 microversion: 2.20 time: 0.107368 Jan 25 03:44:10.441003 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 619/1162] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:10 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 33515 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:10.477958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:10.485476 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1f34248d-798c-41ce-b9c5-8c0bb00be767 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.155465 Jan 25 03:44:10.486042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 544/1163] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:10 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:11.337592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:11.338214 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:11.345052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:11.345504 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:11.346307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:11.346744 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:11.453601 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-26c0b566-6bc5-42a5-8089-024ed7658933 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:11.454649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-26c0b566-6bc5-42a5-8089-024ed7658933 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:11.460976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26c0b566-6bc5-42a5-8089-024ed7658933 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:11.461504 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26c0b566-6bc5-42a5-8089-024ed7658933 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:11.462286 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26c0b566-6bc5-42a5-8089-024ed7658933 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:11.462726 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-26c0b566-6bc5-42a5-8089-024ed7658933 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:11.502322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:11.510094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-36e1ef06-e75c-43cf-90fb-24b5b2ed5f3d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1762 microversion: 2.1 time: 0.176626 Jan 25 03:44:11.510655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 620/1164] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:11 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1762 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:11.514860 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:11.515491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:11.520796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:11.521247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:11.522012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:11.522445 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:11.565962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-26c0b566-6bc5-42a5-8089-024ed7658933 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 34604 microversion: 2.20 time: 0.116983 Jan 25 03:44:11.570050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 545/1165] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:11 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 34604 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:11.657279 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:11.664489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-83c0b462-ad08-421e-ab7a-8ae5d88930bf tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.152889 Jan 25 03:44:11.665046 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 621/1166] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:11 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:12.578978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c3852d07-db2d-4888-bbfb-45e38e92da19 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:12.580001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c3852d07-db2d-4888-bbfb-45e38e92da19 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:12.587044 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3852d07-db2d-4888-bbfb-45e38e92da19 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:12.587531 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3852d07-db2d-4888-bbfb-45e38e92da19 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:12.588303 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3852d07-db2d-4888-bbfb-45e38e92da19 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:12.588741 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3852d07-db2d-4888-bbfb-45e38e92da19 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:12.681435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:12.682054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:12.689381 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:12.689841 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:12.689963 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c3852d07-db2d-4888-bbfb-45e38e92da19 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 35762 microversion: 2.20 time: 0.115802 Jan 25 03:44:12.693896 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 546/1167] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:12 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 35762 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:12.694039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:12.694039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:12.833650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:12.841343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2621ea83-d04e-4b65-9018-8c6f849e91d8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.163672 Jan 25 03:44:12.841898 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 622/1168] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:12 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:13.702830 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-91f84afb-ebae-4369-8345-04c3c7f02d99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:13.703858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-91f84afb-ebae-4369-8345-04c3c7f02d99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:13.710807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-91f84afb-ebae-4369-8345-04c3c7f02d99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:13.711297 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-91f84afb-ebae-4369-8345-04c3c7f02d99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:13.712079 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-91f84afb-ebae-4369-8345-04c3c7f02d99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:13.712519 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-91f84afb-ebae-4369-8345-04c3c7f02d99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:13.810730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-91f84afb-ebae-4369-8345-04c3c7f02d99 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 37107 microversion: 2.20 time: 0.112532 Jan 25 03:44:13.811428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 547/1169] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:13 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 37107 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:13.857699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:13.858310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:13.864792 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:13.865253 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:13.866040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:13.866484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:14.010349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:14.018054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7a7ca4e5-7cb6-4a58-bdde-000250a41d1f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.164332 Jan 25 03:44:14.018611 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 623/1170] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:13 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:14.822302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-742e1f45-6957-40fe-9143-27aa046e59a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:14.823348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-742e1f45-6957-40fe-9143-27aa046e59a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:14.830188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-742e1f45-6957-40fe-9143-27aa046e59a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:14.830629 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-742e1f45-6957-40fe-9143-27aa046e59a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:14.831426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-742e1f45-6957-40fe-9143-27aa046e59a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:14.831860 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-742e1f45-6957-40fe-9143-27aa046e59a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:14.924277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-742e1f45-6957-40fe-9143-27aa046e59a3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 38231 microversion: 2.20 time: 0.105920 Jan 25 03:44:14.925243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 548/1171] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:14 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 38231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:15.034494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:15.035209 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:15.041460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:15.041914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:15.042686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:15.043990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:15.171312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:15.178545 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fd9bb5ff-cec8-4a45-8bf8-f769daca9d70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.147702 Jan 25 03:44:15.179184 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 624/1172] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:15 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:15.937607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2d9f469a-a0f8-4d53-9b4f-c598e9717f2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:15.938589 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2d9f469a-a0f8-4d53-9b4f-c598e9717f2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:15.945505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d9f469a-a0f8-4d53-9b4f-c598e9717f2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:15.945951 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d9f469a-a0f8-4d53-9b4f-c598e9717f2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:15.946716 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d9f469a-a0f8-4d53-9b4f-c598e9717f2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:15.947178 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2d9f469a-a0f8-4d53-9b4f-c598e9717f2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:16.036612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2d9f469a-a0f8-4d53-9b4f-c598e9717f2b tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 38231 microversion: 2.20 time: 0.103719 Jan 25 03:44:16.037282 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 549/1173] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:15 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 38231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:16.195960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:16.196509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:16.203074 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:16.203541 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:16.204326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:16.204772 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:16.332721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:16.340789 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-863ef575-3a73-4d85-b9ad-c423f86606b8 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.147903 Jan 25 03:44:16.341434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 625/1174] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:16 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:17.049565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-458cb8fc-0f6b-4ef5-b5bc-e95bc02ae6f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:17.050579 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-458cb8fc-0f6b-4ef5-b5bc-e95bc02ae6f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:17.057390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-458cb8fc-0f6b-4ef5-b5bc-e95bc02ae6f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:17.057834 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-458cb8fc-0f6b-4ef5-b5bc-e95bc02ae6f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:17.059150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-458cb8fc-0f6b-4ef5-b5bc-e95bc02ae6f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:17.059585 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-458cb8fc-0f6b-4ef5-b5bc-e95bc02ae6f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:17.143475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-458cb8fc-0f6b-4ef5-b5bc-e95bc02ae6f3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 38231 microversion: 2.20 time: 0.097805 Jan 25 03:44:17.147542 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 550/1175] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:17 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 38231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:17.357351 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:17.357978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:17.365013 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:17.367968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:17.367968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:17.367968 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:17.505789 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:17.513640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c976a2b8-660a-47f4-9b1f-916de8156eb6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.160840 Jan 25 03:44:17.514205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 626/1176] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:17 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:18.156666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e7ff1d0b-35a2-4189-88a2-77a95f8e12a6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:18.157651 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e7ff1d0b-35a2-4189-88a2-77a95f8e12a6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:18.164480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7ff1d0b-35a2-4189-88a2-77a95f8e12a6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:18.164932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7ff1d0b-35a2-4189-88a2-77a95f8e12a6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:18.165701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7ff1d0b-35a2-4189-88a2-77a95f8e12a6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:18.166138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e7ff1d0b-35a2-4189-88a2-77a95f8e12a6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:18.253235 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e7ff1d0b-35a2-4189-88a2-77a95f8e12a6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 38231 microversion: 2.20 time: 0.101349 Jan 25 03:44:18.254163 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 551/1177] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:18 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 38231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:18.529828 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:18.530365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:18.536548 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:18.536995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:18.537761 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:18.538195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:18.667027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:18.674893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2176ebde-a913-43c0-a471-d57544f31b4f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.148789 Jan 25 03:44:18.675484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 627/1178] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:18 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:19.266350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7e8ecb5d-e9e8-4f78-aaeb-763a3de694d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:19.267319 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7e8ecb5d-e9e8-4f78-aaeb-763a3de694d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:19.274220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e8ecb5d-e9e8-4f78-aaeb-763a3de694d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:19.274704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e8ecb5d-e9e8-4f78-aaeb-763a3de694d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:19.275517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e8ecb5d-e9e8-4f78-aaeb-763a3de694d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:19.275957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e8ecb5d-e9e8-4f78-aaeb-763a3de694d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:19.369487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-d10d7e5d-8967-4b6b-873d-926ee8674ef3 req-20dfc4cf-05bd-4b38-b8f6-dc89989aec9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6fc152-dc5c-493a-9933-95f0408e1caa", "name": "network-vif-plugged", "status": "completed", "tag": "b92e2cb6-c6e1-4723-843b-37dd1c830bbb"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:19.369487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:44:19.369487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:44:19.376244 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7e8ecb5d-e9e8-4f78-aaeb-763a3de694d0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 200 len: 38370 microversion: 2.20 time: 0.114534 Jan 25 03:44:19.377784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 552/1179] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:19 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 38370 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:44:19.378025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-d10d7e5d-8967-4b6b-873d-926ee8674ef3 req-20dfc4cf-05bd-4b38-b8f6-dc89989aec9f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:19.378025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-d10d7e5d-8967-4b6b-873d-926ee8674ef3 req-20dfc4cf-05bd-4b38-b8f6-dc89989aec9f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:19.387390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e6e67131-2b5b-490e-a877-d96eea1f80d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:19.393835 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e6e67131-2b5b-490e-a877-d96eea1f80d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:19.393989 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-d10d7e5d-8967-4b6b-873d-926ee8674ef3 req-20dfc4cf-05bd-4b38-b8f6-dc89989aec9f service nova] Creating event network-vif-plugged:b92e2cb6-c6e1-4723-843b-37dd1c830bbb for instance 7c6fc152-dc5c-493a-9933-95f0408e1caa on hv-cinder-81901 Jan 25 03:44:19.395260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e67131-2b5b-490e-a877-d96eea1f80d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:19.395712 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e67131-2b5b-490e-a877-d96eea1f80d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:19.396542 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e67131-2b5b-490e-a877-d96eea1f80d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:19.396920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-d10d7e5d-8967-4b6b-873d-926ee8674ef3 req-20dfc4cf-05bd-4b38-b8f6-dc89989aec9f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033090 Jan 25 03:44:19.397074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e6e67131-2b5b-490e-a877-d96eea1f80d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:19.397542 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 628/1180] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:44:19.422165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e6e67131-2b5b-490e-a877-d96eea1f80d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/ips" status: 200 len: 150 microversion: 2.20 time: 0.038983 Jan 25 03:44:19.425643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 553/1181] 10.222.0.115 () {60 vars in 1293 bytes} [Tue Jan 25 03:44:19 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:44:19.692460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:19.693256 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:19.700615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:19.701852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:19.702067 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:19.703283 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:19.843603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:19.851179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-620abaa7-3f47-4c84-841a-6b8df9137708 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.163418 Jan 25 03:44:19.851777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 629/1182] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:19 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:20.867533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:20.872029 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:20.874859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:20.875351 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:20.876196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:20.876664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:21.013272 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:21.021242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cfdc512e-3570-45f0-aaa5-9a756178be70 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1268 microversion: 2.1 time: 0.157379 Jan 25 03:44:21.021821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 554/1183] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:20 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:22.038479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:22.039277 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:22.049982 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:22.050808 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:22.052256 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:22.053062 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:22.192734 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:22.200534 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8985366d-4fdd-4d3e-9805-a57b99a4234e tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1456 microversion: 2.1 time: 0.165822 Jan 25 03:44:22.201326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 630/1184] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:22 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:22.216923 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:22.217524 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:22.223752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:22.224199 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:22.224959 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:22.225390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:22.357662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:22.365526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-92156af4-2897-4e00-ad3b-c30b794e01d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1456 microversion: 2.1 time: 0.152798 Jan 25 03:44:22.366130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 555/1185] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:22 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1456 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:22.898102 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:22.898680 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:22.905511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:22.909775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:22.909775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:22.909775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:22.930830 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lazy-loading 'flavor' on Instance uuid 6b8302b8-b04f-40ea-a9ff-2461018e7962 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:44:23.466993 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-110969fe-9c44-45e0-80ef-b6113696ad77 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 202 len: 0 microversion: 2.20 time: 0.574302 Jan 25 03:44:23.468071 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 631/1186] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:22 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:44:23.475578 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:23.476241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:23.483796 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:23.484241 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:23.485026 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:23.485471 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:23.680583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:23.688869 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:23.690401 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:23.691607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-37735666-ed58-49c3-a498-dc46952aef88 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.219705 Jan 25 03:44:23.692174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 556/1187] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:23 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:24.566304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-22865c36-0c9b-4188-9751-5cdb295b1a00 req-1eec8c46-d6cf-4c47-8913-1c379358e00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6fc152-dc5c-493a-9933-95f0408e1caa", "tag": "b92e2cb6-c6e1-4723-843b-37dd1c830bbb"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:24.567855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:44:24.567855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:44:24.575719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-22865c36-0c9b-4188-9751-5cdb295b1a00 req-1eec8c46-d6cf-4c47-8913-1c379358e00d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:24.576189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-22865c36-0c9b-4188-9751-5cdb295b1a00 req-1eec8c46-d6cf-4c47-8913-1c379358e00d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:24.586840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-22865c36-0c9b-4188-9751-5cdb295b1a00 req-1eec8c46-d6cf-4c47-8913-1c379358e00d service nova] Creating event network-changed:b92e2cb6-c6e1-4723-843b-37dd1c830bbb for instance 7c6fc152-dc5c-493a-9933-95f0408e1caa on hv-cinder-81901 Jan 25 03:44:24.591743 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-22865c36-0c9b-4188-9751-5cdb295b1a00 req-1eec8c46-d6cf-4c47-8913-1c379358e00d service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030178 Jan 25 03:44:24.592385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 632/1188] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:44:24.709936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:24.710618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:24.717226 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:24.717683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:24.718478 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:24.718919 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:24.930554 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:24.940014 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:24.941672 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:24.942838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d11f1e21-81e3-4022-b6c1-90de8add73a7 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.237018 Jan 25 03:44:24.943650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 557/1189] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:24 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:25.962588 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:25.963318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:25.969566 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:25.970601 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:25.970601 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:25.971225 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:26.099827 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:26.108128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:26.109633 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:26.110796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5f55caba-86f9-4892-8b4f-dc141e209d12 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.152769 Jan 25 03:44:26.111393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 633/1190] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:25 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:27.128967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:27.129570 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:27.135883 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:27.136330 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:27.137097 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:27.137595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:27.267547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:27.275123 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:27.276545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:27.277681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5efefff2-e992-4ca9-a5c2-355182895fe3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.152506 Jan 25 03:44:27.278280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 558/1191] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:27 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:28.296164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:28.296776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:28.303686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:28.304337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:28.305137 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:28.305580 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:28.442970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:28.451140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:28.452671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:28.453832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a1e12e8f-f280-42d0-91b5-11a1c851bb9f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.162271 Jan 25 03:44:28.454388 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 634/1192] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:28 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:29.478641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:29.478641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:29.479585 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:29.480037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:29.480815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:29.481610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:29.615397 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:29.626083 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:29.628706 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:29.629870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-faaf4004-8469-4119-a6f0-2f3138496384 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.161227 Jan 25 03:44:29.630434 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 559/1193] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:29 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:30.404501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:30.405041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:30.411360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:30.411818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:30.412604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:30.413050 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:30.436736 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lazy-loading 'flavor' on Instance uuid 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:44:30.647572 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:30.648188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:30.655225 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:30.655681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:30.656503 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:30.656949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:30.695250 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-cae9aef1-eb9c-472a-847f-42ec5d172cd5 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "POST /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d/action" status: 202 len: 0 microversion: 2.1 time: 0.294499 Jan 25 03:44:30.695855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 635/1194] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:44:30 2022] POST /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:30.709313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:30.710008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:30.716779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:30.717232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:30.718020 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:30.718456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:30.787937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:30.797020 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:30.798505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:30.799707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-57a6b992-d172-4b36-806a-48e17f76be18 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.156152 Jan 25 03:44:30.800266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 560/1195] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:30 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:44:30.855379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:30.863450 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d754d3f7-6f00-411b-9442-4598c6a8f8b0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.163033 Jan 25 03:44:30.864031 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 636/1196] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:30 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:31.817691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:31.818302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:31.825162 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:31.825711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:31.826494 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:31.826934 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:31.880884 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:31.881512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:31.888465 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:31.888918 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:31.889700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:31.890139 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:31.960335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:31.969098 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:31.975228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:31.975228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-18f27a88-9fc1-4564-acc6-a0263c36f541 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.157858 Jan 25 03:44:31.975228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 561/1197] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:31 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:32.025745 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:32.034062 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f75ff099-39ad-418b-90b0-9e4e82d1579e tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.156859 Jan 25 03:44:32.034625 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 637/1198] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:31 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:32.990007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:32.990612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:32.997385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:32.999073 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:32.999073 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:32.999073 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:33.050520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:33.051167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:33.058104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:33.058565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:33.059578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:33.060199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:33.133425 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:33.141633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:33.143161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:33.144340 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a1fdf4de-bf34-4b83-8bcf-84e2d269d3b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.158117 Jan 25 03:44:33.144926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 562/1199] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:32 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:33.209074 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:33.216972 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9b6314a8-1c42-434d-a29e-7e05603b8c9f tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.170172 Jan 25 03:44:33.217529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 638/1200] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:33 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:34.162647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:34.163302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:34.170075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:34.170526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:34.171325 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:34.171772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:34.233960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:34.234629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:34.240783 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:34.241242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:34.242038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:34.242490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:34.302843 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:34.310709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:34.312507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:34.313664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d279a5cf-1c43-4ca5-bbc9-92e4c8e0cd91 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.154754 Jan 25 03:44:34.314228 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 563/1201] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:34 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:34.378222 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:34.385412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d28be7b2-098c-4940-a3c1-195a0ecb70fe tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.155661 Jan 25 03:44:34.385975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 639/1202] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:34 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:35.331941 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:35.332532 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:35.338908 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:35.339399 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:35.340266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:35.340752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:35.402788 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:35.403645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:35.409807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:35.410274 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:35.411078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:35.411530 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:35.470625 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:35.478497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:35.480053 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:35.481887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d0dc10aa-c87c-4f7a-87a0-3158f6a38267 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1745 microversion: 2.20 time: 0.153638 Jan 25 03:44:35.482459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 564/1203] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:35 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:35.540913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:35.548988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f4c7b95f-f58c-4aa5-867b-2e7f08690231 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.149968 Jan 25 03:44:35.549558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 640/1204] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:35 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:36.500140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:36.500738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:36.507515 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:36.508021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:36.508803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:36.509268 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:36.566094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:36.566715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:36.573023 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:36.573485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:36.574310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:36.575435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:36.640321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:36.648216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:36.649729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:36.650925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-eec4dbec-37cf-4aaa-96d9-37481962340c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1745 microversion: 2.20 time: 0.154711 Jan 25 03:44:36.651558 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 565/1205] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:36 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:36.705653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:36.713030 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8d00a816-f2b4-4ac5-bd55-cb29717a02f9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.150635 Jan 25 03:44:36.713606 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 641/1206] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:36 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:37.670246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:37.670849 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:37.677168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:37.677617 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:37.678394 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:37.678833 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:37.738102 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:37.738626 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:37.745026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:37.745724 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:37.746553 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:37.747604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:37.831935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:37.841775 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:37.843686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:37.845803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-58a996ae-5653-4bb4-942e-bd6ee32a4306 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1745 microversion: 2.20 time: 0.179888 Jan 25 03:44:37.846901 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 566/1207] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:37 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:37.905745 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:37.913088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-65cc24b2-bc04-417d-8df7-98c3bbd0ab85 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.178795 Jan 25 03:44:37.913648 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 642/1208] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:37 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:38.865247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:38.865852 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:38.872827 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:38.873277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:38.874054 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:38.874500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:38.929396 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:38.930037 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:38.937251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:38.937713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:38.938495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:38.938930 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:39.007671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:39.015744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:39.017242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:39.018527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0f1c0b6b-8df9-4744-9b12-cdaafdd9eccf tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1745 microversion: 2.20 time: 0.156935 Jan 25 03:44:39.019136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 567/1209] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:38 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:39.069240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:39.076914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-64427ce1-6b72-402a-be27-429f95efaaa1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.151156 Jan 25 03:44:39.077491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 643/1210] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:38 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:39.392470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-6667a8b5-9c48-45c7-8455-c51fca84b29d req-99d0a105-e3dd-4749-917d-3092be449da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8302b8-b04f-40ea-a9ff-2461018e7962", "name": "network-vif-plugged", "status": "completed", "tag": "9f6cee72-9dab-452f-955a-9024f4b6b9f4"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:39.394032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:44:39.394032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:44:39.400703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-6667a8b5-9c48-45c7-8455-c51fca84b29d req-99d0a105-e3dd-4749-917d-3092be449da1 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:39.401143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-6667a8b5-9c48-45c7-8455-c51fca84b29d req-99d0a105-e3dd-4749-917d-3092be449da1 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:39.412206 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-6667a8b5-9c48-45c7-8455-c51fca84b29d req-99d0a105-e3dd-4749-917d-3092be449da1 service nova] Creating event network-vif-plugged:9f6cee72-9dab-452f-955a-9024f4b6b9f4 for instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 on hv-cinder-81901 Jan 25 03:44:39.417169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-6667a8b5-9c48-45c7-8455-c51fca84b29d req-99d0a105-e3dd-4749-917d-3092be449da1 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028302 Jan 25 03:44:39.417742 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 568/1211] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:44:40.036979 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:40.038020 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:40.045152 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:40.045621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:40.046437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:40.046846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:40.095388 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:40.096153 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:40.102390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:40.102904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:40.103805 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:40.104307 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:40.189382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:40.204001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:40.206938 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:40.210807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-776d4562-76f5-4190-90b4-e08accb5db8f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.176749 Jan 25 03:44:40.211913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 644/1212] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:40 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:40.266691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:40.274379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-04f226ba-2521-4b97-92da-23fca8f493ac tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.183866 Jan 25 03:44:40.285385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 569/1213] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:40 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:41.230862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:41.232781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:41.240452 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:41.241261 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:41.242488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:41.243405 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:41.293129 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:41.294696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:41.304710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:41.307604 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:41.310103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:41.311646 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:41.442631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:41.451941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:41.453460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:41.454657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-394fc350-b149-4cdc-81c0-b8432bc85612 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.227951 Jan 25 03:44:41.456728 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 645/1214] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:41 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:41.601181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:41.610480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-75261e53-9e36-49b2-a09f-d30079fc2fa8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.321486 Jan 25 03:44:41.614671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 570/1215] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:41 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:42.475832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:42.477182 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:42.485384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:42.485905 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:42.486821 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:42.487337 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:42.632935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:42.633812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:42.638678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:42.647955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:42.648463 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:42.648594 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:42.649591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:42.650047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:42.650393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:42.651713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-78ddca2d-39a5-4e91-a4c9-f433eefd3cd8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.179831 Jan 25 03:44:42.652549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 646/1216] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:42 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:42.802052 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:42.813440 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-70eafd3d-c8ab-4366-aa92-7caaf51c36f0 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.185465 Jan 25 03:44:42.814031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 571/1217] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:42 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:43.670301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:43.671100 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:43.678262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:43.678721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:43.679540 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:43.679981 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:43.847450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:43.848307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:43.849112 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:43.856147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:43.857386 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:43.858450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:43.859165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:43.859620 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:43.861316 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:43.862480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-66aabc22-2b9f-4a6f-8b26-69e7be0f4c1d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.196632 Jan 25 03:44:43.873398 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 647/1218] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:43 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:44.016752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:44.024794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-dd95f9b1-fcc6-495d-937e-6f3d0b65b7b2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.194547 Jan 25 03:44:44.025912 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 572/1219] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:43 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:44.883001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:44.883822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:44.892334 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:44.893206 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:44.894196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:44.894641 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:45.042253 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:45.049943 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:45.053781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:45.064003 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:45.065466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:45.067163 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:45.067694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:45.068565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:45.070317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:45.070850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6947b59f-487b-4437-b4cb-a0fab86485d5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.192637 Jan 25 03:44:45.077719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 648/1220] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:44 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:45.226051 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:45.237301 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3e2f600f-d45b-4462-a3f2-7aadb1cda8a2 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1572 microversion: 2.1 time: 0.192152 Jan 25 03:44:45.238883 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 573/1221] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:45 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1572 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:45.257240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-094519fb-77d0-41ad-8c46-03e9af872eab tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:45.257889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-094519fb-77d0-41ad-8c46-03e9af872eab tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:45.267781 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-094519fb-77d0-41ad-8c46-03e9af872eab tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:45.268325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-094519fb-77d0-41ad-8c46-03e9af872eab tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:45.269207 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-094519fb-77d0-41ad-8c46-03e9af872eab tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:45.269711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-094519fb-77d0-41ad-8c46-03e9af872eab tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:45.501150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-094519fb-77d0-41ad-8c46-03e9af872eab tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "POST /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d/action" status: 202 len: 0 microversion: 2.1 time: 0.247426 Jan 25 03:44:45.501681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 649/1222] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:44:45 2022] POST /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:44:45.512362 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:45.513136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:45.522539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:45.523005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:45.524979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:45.527870 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:45.741108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:45.757229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-753665c1-d71f-4083-9759-fb0e063805fa tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1520 microversion: 2.1 time: 0.248563 Jan 25 03:44:45.757924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 574/1223] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:45 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:46.095621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:46.096481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:46.104931 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:46.105991 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:46.106717 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:46.107354 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:46.268100 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:46.276525 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:46.279283 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:46.282975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4ed59b3f-f9fe-487d-8977-878a63315c83 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.191078 Jan 25 03:44:46.294462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 650/1224] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:46 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:46.779394 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:46.780747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:46.787890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:46.788543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:46.789504 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:46.790096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:46.951619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:46.959892 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7918e89d-907f-4711-97da-ec4f72063870 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1522 microversion: 2.1 time: 0.184474 Jan 25 03:44:46.960686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 575/1225] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:46 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:47.301747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:47.303260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:47.313591 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:47.314412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:47.315469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:47.316186 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:47.430935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-dce3a8d8-f237-46bf-a7d2-37cf58427ec3 req-7dbe76ad-a6a5-4406-a0d2-fc52eff9e909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d", "name": "network-vif-unplugged", "status": "completed", "tag": "b93b0fe2-4ab5-4c3c-81e5-39ac08ded566"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:47.432762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:44:47.432762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:44:47.447321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-dce3a8d8-f237-46bf-a7d2-37cf58427ec3 req-7dbe76ad-a6a5-4406-a0d2-fc52eff9e909 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:47.448182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-dce3a8d8-f237-46bf-a7d2-37cf58427ec3 req-7dbe76ad-a6a5-4406-a0d2-fc52eff9e909 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:47.466705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.compute.server_external_events [req-dce3a8d8-f237-46bf-a7d2-37cf58427ec3 req-7dbe76ad-a6a5-4406-a0d2-fc52eff9e909 service nova] Unable to find a host for instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d. Dropping event network-vif-unplugged {{(pid=123363) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 25 03:44:47.469083 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-dce3a8d8-f237-46bf-a7d2-37cf58427ec3 req-7dbe76ad-a6a5-4406-a0d2-fc52eff9e909 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041209 Jan 25 03:44:47.469083 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 576/1226] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 25 03:44:47.513840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:47.528749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:47.540705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:47.543753 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ff7c4169-cbdd-45da-bb5a-952ceca6cef0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.245228 Jan 25 03:44:47.558952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 651/1227] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:47 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:47.981809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:47.982497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:47.989410 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:47.989983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:47.991088 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:47.991898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:48.149746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:48.161715 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bb108ccf-a8e3-4d48-997a-b74d907eed13 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1522 microversion: 2.1 time: 0.185212 Jan 25 03:44:48.162705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 577/1228] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:47 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:48.566616 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:48.567267 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:48.573873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:48.575213 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:48.579288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:48.579978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:48.733844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:48.750978 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:48.752610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:48.753866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f07aa0b4-2996-4a44-92be-670d56c9cd92 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.191511 Jan 25 03:44:48.758451 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 652/1229] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:48 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:49.180389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:49.181033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:49.187825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:49.188282 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:49.189117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:49.189564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:49.419050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:49.429521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f1189fa9-7719-4a52-8f83-4758127b1d3b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.252981 Jan 25 03:44:49.431502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 578/1230] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:49 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:49.772558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:49.773385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:49.780989 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:49.781718 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:49.782615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:49.783413 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:49.921550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:49.929398 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:49.930884 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:49.932072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5b32c58a-4955-43f4-bf09-79c3b33b254f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.163551 Jan 25 03:44:49.932623 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 653/1231] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:49 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:50.448086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:50.448671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:50.455693 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:50.459591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:50.459591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:50.459591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:50.666203 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:50.674176 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b77cb15a-62c0-41f7-8c6f-2d5af9b8accb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.229750 Jan 25 03:44:50.674748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 579/1232] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:50 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:50.951272 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:50.951873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:50.958190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:50.958649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:50.959462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:50.959908 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:51.091418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:51.099207 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:51.100693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:51.101834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-07b26a37-9e64-474b-be28-998810912793 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1740 microversion: 2.20 time: 0.154639 Jan 25 03:44:51.102389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 654/1233] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:50 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:51.692172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:51.692774 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:51.699588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:51.700047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:51.700849 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:51.701290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:51.985166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:51.991491 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7f1b7f2d-e9eb-4749-9c18-540f36332175 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.303139 Jan 25 03:44:51.992063 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 580/1234] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:51 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:52.120016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:52.120652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:52.127730 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:52.128185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:52.128953 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:52.129389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:52.277941 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:52.285838 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:52.287362 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:52.288557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-bbc85dda-cf46-4bfa-8ddb-274c08230c52 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1722 microversion: 2.20 time: 0.172208 Jan 25 03:44:52.289117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 655/1235] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:52 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:53.008557 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:53.009170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:53.016347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:53.016789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:53.017632 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:53.018062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:53.155785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:53.163242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fcd9f060-7c6a-4f67-a6d8-c953e7149212 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.158402 Jan 25 03:44:53.163812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 581/1236] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:53 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:53.307692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:53.308807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:53.320249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:53.320699 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:53.321474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:53.321906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:53.453965 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:53.461581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:53.463133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:53.464285 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6975fdb8-8452-48aa-86e6-3e93904700d6 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1722 microversion: 2.20 time: 0.160364 Jan 25 03:44:53.464842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 656/1237] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:53 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:54.180168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:54.180716 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:54.187992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:54.193428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:54.193428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:54.193428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:54.321265 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:54.328879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-824717d5-8364-48a2-b0b4-f45a48f8fa6b tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.152407 Jan 25 03:44:54.329452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 582/1238] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:54 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:54.482308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:54.482867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:54.489096 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:54.489540 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:54.490307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:54.490738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:54.624388 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:54.632468 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:54.633957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:54.635145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4143225f-6ed2-45d2-8a60-b74f707b0885 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1725 microversion: 2.20 time: 0.157130 Jan 25 03:44:54.635710 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 657/1239] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:54 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:54.653399 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2f8215ca-b738-42df-abf5-0f0e53111946 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2194c792-8bba-4335-8dc9-2ac6cade6c96"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:54.654461 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2f8215ca-b738-42df-abf5-0f0e53111946 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:54.660366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f8215ca-b738-42df-abf5-0f0e53111946 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:54.660812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f8215ca-b738-42df-abf5-0f0e53111946 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:54.661578 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f8215ca-b738-42df-abf5-0f0e53111946 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:54.662008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2f8215ca-b738-42df-abf5-0f0e53111946 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:55.345881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:55.346511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:55.352938 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:55.353091 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:55.353967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:55.354412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:55.426325 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2f8215ca-b738-42df-abf5-0f0e53111946 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.777212 Jan 25 03:44:55.427465 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 583/1240] 10.222.0.115 () {62 vars in 1368 bytes} [Tue Jan 25 03:44:54 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-volume_attachments => generated 188 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:44:55.488255 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-ffed9222-5d8e-4cf5-a2d0-b71e2acb9a97 req-47c9f9cf-4b4d-448e-8272-dcf7bc468444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8302b8-b04f-40ea-a9ff-2461018e7962", "name": "network-vif-unplugged", "status": "completed", "tag": "9f6cee72-9dab-452f-955a-9024f4b6b9f4"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:55.490061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:44:55.490061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:44:55.496307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:55.504851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-60912211-fb64-461c-8e20-3570122e5e54 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.162704 Jan 25 03:44:55.505631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 658/1241] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:55 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:55.508370 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ffed9222-5d8e-4cf5-a2d0-b71e2acb9a97 req-47c9f9cf-4b4d-448e-8272-dcf7bc468444 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:55.509032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ffed9222-5d8e-4cf5-a2d0-b71e2acb9a97 req-47c9f9cf-4b4d-448e-8272-dcf7bc468444 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:55.521682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.compute.server_external_events [req-ffed9222-5d8e-4cf5-a2d0-b71e2acb9a97 req-47c9f9cf-4b4d-448e-8272-dcf7bc468444 service nova] Unable to find a host for instance 6b8302b8-b04f-40ea-a9ff-2461018e7962. Dropping event network-vif-unplugged {{(pid=123363) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 25 03:44:55.522562 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-ffed9222-5d8e-4cf5-a2d0-b71e2acb9a97 req-47c9f9cf-4b4d-448e-8272-dcf7bc468444 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038240 Jan 25 03:44:55.523170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 584/1242] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 25 03:44:55.549399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a7f55564-4c5e-4131-819a-2613251fe632 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:55.549888 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a7f55564-4c5e-4131-819a-2613251fe632 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:55.555811 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7f55564-4c5e-4131-819a-2613251fe632 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:55.556375 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7f55564-4c5e-4131-819a-2613251fe632 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:55.557168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7f55564-4c5e-4131-819a-2613251fe632 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:55.557604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a7f55564-4c5e-4131-819a-2613251fe632 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:56.072812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a7f55564-4c5e-4131-819a-2613251fe632 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-volume_attachments/2194c792-8bba-4335-8dc9-2ac6cade6c96" status: 202 len: 0 microversion: 2.20 time: 0.527050 Jan 25 03:44:56.073347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 659/1243] 10.222.0.115 () {60 vars in 1461 bytes} [Tue Jan 25 03:44:55 2022] DELETE /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-volume_attachments/2194c792-8bba-4335-8dc9-2ac6cade6c96 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 25 03:44:56.125684 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-65060944-aeea-4896-8d8c-18d22d1f1ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:44:56.126243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-65060944-aeea-4896-8d8c-18d22d1f1ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:56.132055 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65060944-aeea-4896-8d8c-18d22d1f1ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:56.132495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65060944-aeea-4896-8d8c-18d22d1f1ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:56.133248 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65060944-aeea-4896-8d8c-18d22d1f1ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:56.133673 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65060944-aeea-4896-8d8c-18d22d1f1ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:56.356772 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-65060944-aeea-4896-8d8c-18d22d1f1ab3 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action" status: 202 len: 0 microversion: 2.20 time: 0.234596 Jan 25 03:44:56.357391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 585/1244] 10.222.0.115 () {62 vars in 1323 bytes} [Tue Jan 25 03:44:56 2022] POST /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:44:56.365501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:56.366270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:56.373432 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:56.373970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:56.374873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:56.375346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:56.512816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:56.521143 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:56.522875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:56.523364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:56.524079 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0eddac40-97b0-4959-a5f7-5fd259782565 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1673 microversion: 2.20 time: 0.162471 Jan 25 03:44:56.524192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:56.524634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 660/1245] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:56 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:56.530647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:56.531123 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:56.534021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:56.534021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:56.691259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:56.698506 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8d271cc0-a0d0-4b8c-805a-457676d2c338 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.178764 Jan 25 03:44:56.699725 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 586/1246] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:56 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:44:57.544199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:57.544809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:57.552402 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:57.552963 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:57.553776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:57.554282 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:57.684684 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:57.692871 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:57.694382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:57.695615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-406fcdd5-8959-4330-86ea-0f134ace1f4d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.155356 Jan 25 03:44:57.696311 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 661/1247] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:57 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:44:57.716522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:57.717189 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:57.723474 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:57.723926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:57.724700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:57.725161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:57.853971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:57.862243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9b4fc722-2883-4809-804d-4a67ea073edc tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.149913 Jan 25 03:44:57.862805 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 587/1248] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:57 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:58.713563 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:58.714319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:58.722058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:58.722058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:58.722747 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:58.723219 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:58.854656 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:58.863081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:58.864631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:58.865799 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-43b6cdce-12de-4840-b924-5b905ad5926c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.155917 Jan 25 03:44:58.866419 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 662/1249] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:58 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:44:58.879170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:58.879816 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:58.886022 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:58.886471 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:58.887812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:58.888249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:59.039973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:44:59.048588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3c45ca55-4ad7-4283-93a7-8ef90bcfb1cb tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.173087 Jan 25 03:44:59.059665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 588/1250] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:44:58 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:44:59.884550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:44:59.885164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:44:59.892738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:59.893236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:44:59.894081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:44:59.894529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:00.069381 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:00.070129 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:00.071170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:00.081030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:00.081974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:00.083613 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:00.084395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:00.084536 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:00.086243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:00.087920 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-100db865-01f8-417b-bcc2-2e06708f0178 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.206920 Jan 25 03:45:00.091145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 663/1251] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:44:59 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:00.297503 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:00.308721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e8201f4a-ce62-4561-9f68-ad71f8a29701 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.243731 Jan 25 03:45:00.312509 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 589/1252] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:00 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:01.109458 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:01.110128 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:01.116457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:01.117245 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:01.118043 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:01.118491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:01.259780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:01.269312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:01.272683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:01.272683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e6806824-6b8a-4280-b01b-7598ccbb1d84 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.166809 Jan 25 03:45:01.272683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 664/1253] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:01 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:01.329878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:01.331156 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:01.338055 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:01.338757 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:01.339771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:01.341124 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:01.503944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:01.513090 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-dca52683-d4c3-4a4a-be42-fd52df44aad1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.185995 Jan 25 03:45:01.514166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 590/1254] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:01 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:01.565691 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-9c9ed5b0-cd77-4379-9b7e-3b38ea66b76c req-49befd6f-81bb-4d7d-b8c5-15002b24d9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d", "name": "network-vif-plugged", "status": "completed", "tag": "b93b0fe2-4ab5-4c3c-81e5-39ac08ded566"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:45:01.567906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:45:01.567906 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:45:01.576689 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-9c9ed5b0-cd77-4379-9b7e-3b38ea66b76c req-49befd6f-81bb-4d7d-b8c5-15002b24d9e9 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:01.577130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-9c9ed5b0-cd77-4379-9b7e-3b38ea66b76c req-49befd6f-81bb-4d7d-b8c5-15002b24d9e9 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:01.589127 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-9c9ed5b0-cd77-4379-9b7e-3b38ea66b76c req-49befd6f-81bb-4d7d-b8c5-15002b24d9e9 service nova] Creating event network-vif-plugged:b93b0fe2-4ab5-4c3c-81e5-39ac08ded566 for instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d on hv-cinder-81901 Jan 25 03:45:01.597264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-9c9ed5b0-cd77-4379-9b7e-3b38ea66b76c req-49befd6f-81bb-4d7d-b8c5-15002b24d9e9 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Jan 25 03:45:01.598407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 665/1255] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:45:02.290907 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:02.291555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:02.298358 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:02.298800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:02.300260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:02.300260 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:02.445985 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:02.454322 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:02.455866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:02.457052 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-27210d2a-4e10-460f-9de1-780426686a45 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.169880 Jan 25 03:45:02.457950 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 591/1256] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:02 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:02.532780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:02.533499 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:02.540563 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:02.541532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:02.542284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:02.542735 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:02.691874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:02.701660 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6a6b5354-0836-4622-8397-8f10c8ed8765 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.173236 Jan 25 03:45:02.702216 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 666/1257] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:02 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:45:03.475777 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:03.476391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:03.482803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:03.483310 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:03.484143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:03.484647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:03.619695 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:03.628422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:03.629989 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:03.631120 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-dd7fa045-bf6c-4569-b34c-3dfaf3df7484 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.159128 Jan 25 03:45:03.631678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 592/1258] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:03 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:03.717674 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:03.718283 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:03.726707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:03.727467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:03.728286 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:03.728731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:03.876287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:03.884855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-51bbd632-6e1d-4fcd-88d7-2cb119ebc7cd tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.170990 Jan 25 03:45:03.885700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 667/1259] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:03 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:04.649731 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:04.650346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:04.657514 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:04.657962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:04.659047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:04.659541 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:04.805443 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:04.815689 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:04.817249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:04.818415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-379511e1-9196-4818-b80a-257c33df49b4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.172394 Jan 25 03:45:04.819007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 593/1260] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:04 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:04.902209 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:04.903561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:04.910242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:04.910964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:04.911984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:04.912424 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:05.054773 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:05.068857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5d7cf03d-295d-4383-a169-a2f4f6aafbb1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.170329 Jan 25 03:45:05.069748 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 668/1261] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:04 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:05.842660 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:05.848591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:05.860192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:05.860661 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:05.861817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:05.862597 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:06.026842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:06.026842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:06.027160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:06.027160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-02a3935d-54d2-4a31-93ce-7c5223354ec8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.188139 Jan 25 03:45:06.027160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 594/1262] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:05 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:06.088094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:06.088094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:06.119517 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:06.119896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:06.120738 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:06.121328 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:06.266878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:06.275087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-80f1719f-2c59-4a26-87ba-478f8fa8d04d tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.191902 Jan 25 03:45:06.276992 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 669/1263] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:06 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:07.045717 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:07.046258 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:07.052625 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:07.053068 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:07.053846 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:07.054277 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:07.201573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:07.214160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:07.214160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:07.214160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3b660c01-186d-4d3c-bccc-28169b1ba029 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.172809 Jan 25 03:45:07.222754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 595/1264] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:07 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:07.292642 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:07.293910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:07.300222 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:07.300672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:07.301436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:07.301876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:07.447338 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:07.453288 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-26b8ed58-0eb6-4bc0-ae4c-99ed4a717957 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.164220 Jan 25 03:45:07.453873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 670/1265] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:07 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:08.233113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:08.233860 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:08.240475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:08.241160 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:08.241940 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:08.242373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:08.372751 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:08.380507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:08.381974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:08.383133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7e56ba80-5b23-44b8-b944-cfb870702a9d tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.154652 Jan 25 03:45:08.383690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 596/1266] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:08 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:08.469985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:08.470589 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:08.476952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:08.477408 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:08.478416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:08.478861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:08.611971 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:08.619174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6e2c7d26-e014-4d2d-bbf1-fc88aeb13ee7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.152825 Jan 25 03:45:08.619749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 671/1267] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:08 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:09.401493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:09.402096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:09.409298 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:09.409748 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:09.410521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:09.410956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:09.540335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:09.547924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:09.549405 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:09.550542 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2951e2ee-f85b-410c-9fe2-ce7697bebda4 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.152763 Jan 25 03:45:09.551127 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 597/1268] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:09 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:09.636369 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:09.637743 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:09.643853 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:09.644315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:09.645097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:09.645539 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:09.774847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:09.782410 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e4061963-2bc0-43c2-bfa3-9d7324746136 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.149674 Jan 25 03:45:09.782988 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 672/1269] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:09 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:10.568747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:10.569380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:10.575693 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:10.576143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:10.576926 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:10.577368 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:10.706163 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:10.713878 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:10.716181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:10.717337 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8b35c2a4-36f8-4101-bdb5-a3b555d26145 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.152330 Jan 25 03:45:10.717903 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 598/1270] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:10 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:10.799011 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:10.799644 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:10.806314 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:10.806997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:10.807814 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:10.808254 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:10.946039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:10.953982 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4c70c24f-d5b1-4932-8546-727168e713e9 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.158628 Jan 25 03:45:10.954557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 673/1271] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:10 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:11.735278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:11.735868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:11.742164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:11.742617 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:11.743422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:11.743866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:11.877769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:11.885488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:11.887671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:11.888791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-33105df1-e0f3-46cc-bc37-9cf4b6f9d8bc tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.157233 Jan 25 03:45:11.889359 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 599/1272] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:11 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:11.970729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:11.971391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:11.977682 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:11.978148 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:11.978948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:11.979422 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:12.106227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:12.114383 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f8563193-e6a6-4d93-8514-80fde3b60859 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1578 microversion: 2.1 time: 0.147275 Jan 25 03:45:12.114958 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 674/1273] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:11 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:12.906335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:12.906977 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:12.913312 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:12.913763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:12.914538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:12.914974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:13.047198 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:13.055301 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:13.056811 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:13.058007 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b162c1ff-caef-452b-8d07-6c6fb46eb41a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.156149 Jan 25 03:45:13.058629 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 600/1274] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:12 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:13.131702 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:13.132448 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:13.139462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:13.143170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:13.143170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:13.143170 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:13.276179 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:13.284366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ec28070f-9545-4a96-afa0-0f4aa3edcdc7 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1565 microversion: 2.1 time: 0.156340 Jan 25 03:45:13.284939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 675/1275] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:13 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:14.076768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:14.077379 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:14.083701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:14.084152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:14.084933 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:14.085372 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:14.218040 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:14.225703 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:14.227210 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:14.228388 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-04d4438d-f3e9-4762-b326-47b9d2ce5bf5 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.155494 Jan 25 03:45:14.228973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 601/1276] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:14 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:15.150742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1156778441"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:45:15.151308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:15.158549 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:15.159004 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:15.159819 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:15.160257 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:15.247550 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:15.248214 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:15.254535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:15.254989 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:15.255820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:15.256261 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:15.286469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.network.security_group_api [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Removing security group e8bc47c3-42cf-496d-8551-6de4cc3f0491 from port 596e847a-8586-402f-8511-f40dab535655 Jan 25 03:45:15.388266 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:15.396092 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:15.397593 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:15.398742 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5ff349e5-ab48-4cc5-b3f7-b68b95a1a1b1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.155572 Jan 25 03:45:15.399352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 602/1277] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:15 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:45:15.676492 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-adb62fea-8927-4b24-9c5a-d69aaab23ca0 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/action" status: 202 len: 0 microversion: 2.1 time: 0.529228 Jan 25 03:45:15.681350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 676/1278] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:45:15 2022] POST /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:45:15.689446 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-51ed4acc-7044-47a8-bc4d-30a273724d56 req-18501beb-b191-4afe-b4c8-c2abab4f6777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447c6612-9f1b-4064-b6ed-7ee5dc89f827", "tag": "596e847a-8586-402f-8511-f40dab535655"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:45:15.690555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:45:15.690555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:45:15.697698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-51ed4acc-7044-47a8-bc4d-30a273724d56 req-18501beb-b191-4afe-b4c8-c2abab4f6777 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:15.698481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-51ed4acc-7044-47a8-bc4d-30a273724d56 req-18501beb-b191-4afe-b4c8-c2abab4f6777 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:15.736162 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-51ed4acc-7044-47a8-bc4d-30a273724d56 req-18501beb-b191-4afe-b4c8-c2abab4f6777 service nova] Creating event network-changed:596e847a-8586-402f-8511-f40dab535655 for instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 on hv-cinder-81901 Jan 25 03:45:15.741357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-51ed4acc-7044-47a8-bc4d-30a273724d56 req-18501beb-b191-4afe-b4c8-c2abab4f6777 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056256 Jan 25 03:45:15.741965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 603/1279] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:45:16.417326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:16.418621 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:16.425581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:16.426032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:16.426814 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:16.427296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:16.591341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:16.599149 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:16.600636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:16.601782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6d7f2697-f9c4-47d3-a260-ee3a6f17de2e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.188659 Jan 25 03:45:16.602339 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 677/1280] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:16 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:17.074147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:17.074850 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:17.080922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.081438 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.082301 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.082799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.161516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lazy-loading 'services' on Instance uuid 447c6612-9f1b-4064-b6ed-7ee5dc89f827 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:45:17.359035 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-db4496ea-01c1-47b9-9552-3485bd35dfd8 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "DELETE /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments/6a3a650a-de2a-4eab-a5dd-836a0c4cfc75" status: 202 len: 0 microversion: 2.1 time: 0.289134 Jan 25 03:45:17.359687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 604/1281] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:45:17 2022] DELETE /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments/6a3a650a-de2a-4eab-a5dd-836a0c4cfc75 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:45:17.367703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-64d05e7c-9671-412e-9516-0c27d07e7e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:17.369126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-64d05e7c-9671-412e-9516-0c27d07e7e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:17.375330 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64d05e7c-9671-412e-9516-0c27d07e7e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.375801 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64d05e7c-9671-412e-9516-0c27d07e7e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.376606 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64d05e7c-9671-412e-9516-0c27d07e7e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.377039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-64d05e7c-9671-412e-9516-0c27d07e7e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.407707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-64d05e7c-9671-412e-9516-0c27d07e7e1a tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043507 Jan 25 03:45:17.408285 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 678/1282] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:45:17 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:45:17.620108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:17.620820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:17.626936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.627426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.628207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.628648 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.755985 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-b22f4a6f-21e4-4dfd-96ed-f0bbed60cb32 req-5e879701-ff51-436e-aec9-8a226c134c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "447c6612-9f1b-4064-b6ed-7ee5dc89f827", "tag": "596e847a-8586-402f-8511-f40dab535655"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:45:17.757615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:45:17.757615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:45:17.765657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-b22f4a6f-21e4-4dfd-96ed-f0bbed60cb32 req-5e879701-ff51-436e-aec9-8a226c134c28 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.766103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-b22f4a6f-21e4-4dfd-96ed-f0bbed60cb32 req-5e879701-ff51-436e-aec9-8a226c134c28 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.768791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:17.776580 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:17.778719 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-b22f4a6f-21e4-4dfd-96ed-f0bbed60cb32 req-5e879701-ff51-436e-aec9-8a226c134c28 service nova] Creating event network-changed:596e847a-8586-402f-8511-f40dab535655 for instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 on hv-cinder-81901 Jan 25 03:45:17.778874 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:17.780094 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4ff2d3e7-b5fd-42ef-b3f8-8e524970389a tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.164151 Jan 25 03:45:17.780662 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 605/1283] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:17 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:17.790510 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-b22f4a6f-21e4-4dfd-96ed-f0bbed60cb32 req-5e879701-ff51-436e-aec9-8a226c134c28 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038061 Jan 25 03:45:17.791139 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 679/1284] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:45:17.817730 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-ca2b59e5-5c01-4dca-9131-9a4050cd378b req-f8335c76-8d71-47ac-8ec3-10981de8242f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8302b8-b04f-40ea-a9ff-2461018e7962", "name": "network-vif-plugged", "status": "completed", "tag": "9f6cee72-9dab-452f-955a-9024f4b6b9f4"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:45:17.819318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:45:17.819318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:45:17.828677 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ca2b59e5-5c01-4dca-9131-9a4050cd378b req-f8335c76-8d71-47ac-8ec3-10981de8242f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:17.829130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-ca2b59e5-5c01-4dca-9131-9a4050cd378b req-f8335c76-8d71-47ac-8ec3-10981de8242f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:17.840506 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-ca2b59e5-5c01-4dca-9131-9a4050cd378b req-f8335c76-8d71-47ac-8ec3-10981de8242f service nova] Creating event network-vif-plugged:9f6cee72-9dab-452f-955a-9024f4b6b9f4 for instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 on hv-cinder-81901 Jan 25 03:45:17.845556 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-ca2b59e5-5c01-4dca-9131-9a4050cd378b req-f8335c76-8d71-47ac-8ec3-10981de8242f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031394 Jan 25 03:45:17.846161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 606/1285] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:45:18.420771 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2a87fb40-d108-4c47-87de-732a0c81e672 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:18.421787 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2a87fb40-d108-4c47-87de-732a0c81e672 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:18.429461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a87fb40-d108-4c47-87de-732a0c81e672 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:18.430201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a87fb40-d108-4c47-87de-732a0c81e672 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:18.431278 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a87fb40-d108-4c47-87de-732a0c81e672 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:18.432108 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2a87fb40-d108-4c47-87de-732a0c81e672 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:18.465422 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2a87fb40-d108-4c47-87de-732a0c81e672 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049117 Jan 25 03:45:18.466014 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 680/1286] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:45:18 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:45:18.799355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:18.800054 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:18.806067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:18.806515 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:18.807311 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:18.807751 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:18.949466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:18.957304 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:18.958783 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:18.959981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-260c602b-22c1-46a4-8989-2f6829e0e005 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.165185 Jan 25 03:45:18.960716 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 607/1287] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:18 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:19.476815 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-53ed2ed6-6284-4032-bac7-9a79489de1db tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:19.477639 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-53ed2ed6-6284-4032-bac7-9a79489de1db tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:19.484454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53ed2ed6-6284-4032-bac7-9a79489de1db tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:19.484902 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53ed2ed6-6284-4032-bac7-9a79489de1db tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:19.485661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53ed2ed6-6284-4032-bac7-9a79489de1db tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:19.486093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-53ed2ed6-6284-4032-bac7-9a79489de1db tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:19.513511 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-53ed2ed6-6284-4032-bac7-9a79489de1db tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040510 Jan 25 03:45:19.514042 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 681/1288] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:45:19 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:45:19.523495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:19.523991 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:19.530355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:19.530809 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:19.531620 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:19.532061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:19.610407 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] HTTP exception thrown: Instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 is not attached to volume 6a3a650a-de2a-4eab-a5dd-836a0c4cfc75 Jan 25 03:45:19.611012 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Returning 404 to user: Instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 is not attached to volume 6a3a650a-de2a-4eab-a5dd-836a0c4cfc75 {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:45:19.611979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-21d291c5-4113-42ba-9036-347ccee0d9cf tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "DELETE /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments/6a3a650a-de2a-4eab-a5dd-836a0c4cfc75" status: 404 len: 154 microversion: 2.1 time: 0.092378 Jan 25 03:45:19.612527 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 608/1289] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:45:19 2022] DELETE /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827/os-volume_attachments/6a3a650a-de2a-4eab-a5dd-836a0c4cfc75 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:45:19.977618 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:19.978235 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:19.984468 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:19.996016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:19.996016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:19.996016 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:20.119320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:20.128026 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:20.129514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:20.130665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-da1d83d8-0fdb-498d-b07e-404c2e323c23 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.156835 Jan 25 03:45:20.131258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 682/1290] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:19 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:20.858866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:20.859402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:20.865804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:20.866264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:20.867050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:20.867512 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:20.893433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:45:21.148984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:21.149647 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:21.156008 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:21.156467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:21.157249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:21.157692 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:21.160913 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ddbfc9f0-0d1c-4e02-9c1d-74d06db0c03d tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "DELETE /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 204 len: 0 microversion: 2.1 time: 0.302334 Jan 25 03:45:21.160913 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 609/1291] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:45:20 2022] DELETE /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:45:21.169571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:21.170278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:21.176167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:21.176615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:21.177420 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:21.177851 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:21.297032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:21.318045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:21.319448 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:21.320652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5b2b427b-f0b4-4212-a1bd-f0a3cfec28f2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1731 microversion: 2.20 time: 0.175528 Jan 25 03:45:21.321002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:21.321217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 683/1292] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:21 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 25 03:45:21.330597 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-8a24ca30-df0e-426b-aee3-1dfcf8231b40 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1557 microversion: 2.1 time: 0.167783 Jan 25 03:45:21.331339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 610/1293] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:21 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:45:22.339276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:22.340368 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:22.347474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:22.347934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:22.348737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:22.349861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:22.350479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:22.351202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:22.357963 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:22.359166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:22.359297 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:22.359694 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:22.498862 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:22.506566 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-54d65222-4ea7-4086-890b-73e78c894b93 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1557 microversion: 2.1 time: 0.160282 Jan 25 03:45:22.507383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 611/1294] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:22 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:45:22.705159 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:22.712875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:22.714443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:22.715795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-aa2ec43d-e762-4d1a-b373-f60bd168e84c tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1718 microversion: 2.20 time: 0.380356 Jan 25 03:45:22.716365 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 684/1295] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:45:22 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1718 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:45:23.523481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:23.524067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:23.530563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:23.531004 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:23.531797 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:23.532231 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:23.757454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:23.765392 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e085d765-06f9-4162-a2e9-ee12536b6e5c tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1557 microversion: 2.1 time: 0.245565 Jan 25 03:45:23.765968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 612/1296] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:23 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1557 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:24.059032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-81ff1a7e-843d-4f51-95ff-69ba195fd333 req-0c1697e9-bcf0-4339-80d4-47386caef0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "447c6612-9f1b-4064-b6ed-7ee5dc89f827", "name": "network-vif-deleted", "tag": "596e847a-8586-402f-8511-f40dab535655"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:45:24.060864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:45:24.060864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:45:24.068824 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-81ff1a7e-843d-4f51-95ff-69ba195fd333 req-0c1697e9-bcf0-4339-80d4-47386caef0ca service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:24.069303 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-81ff1a7e-843d-4f51-95ff-69ba195fd333 req-0c1697e9-bcf0-4339-80d4-47386caef0ca service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:24.080604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-81ff1a7e-843d-4f51-95ff-69ba195fd333 req-0c1697e9-bcf0-4339-80d4-47386caef0ca service nova] Creating event network-vif-deleted:596e847a-8586-402f-8511-f40dab535655 for instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 on hv-cinder-81901 Jan 25 03:45:24.085816 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-81ff1a7e-843d-4f51-95ff-69ba195fd333 req-0c1697e9-bcf0-4339-80d4-47386caef0ca service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030386 Jan 25 03:45:24.086441 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 685/1297] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:45:24.782004 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:24.782607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:24.788871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:24.790676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:24.790676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:24.790676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:24.820101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:24.820543 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:24.820983 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lazy-loading 'fault' on Instance uuid 447c6612-9f1b-4064-b6ed-7ee5dc89f827 {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:45:24.863138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e73df04cd61461b8811b4c57da7ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4705507d68244c7a9a99369120f0a3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:45:24.870385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bdc0ae9b-adcf-4723-8d25-c922be87a0fe tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 200 len: 1351 microversion: 2.1 time: 0.091960 Jan 25 03:45:24.870947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 613/1298] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:24 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:45:25.888862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:25.889557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [instance: 447c6612-9f1b-4064-b6ed-7ee5dc89f827] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:45:25.895573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:25.896024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:25.896784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:45:25.897216 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:45:25.910447 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] HTTP exception thrown: Instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 could not be found. Jan 25 03:45:25.911015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Returning 404 to user: Instance 447c6612-9f1b-4064-b6ed-7ee5dc89f827 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:45:25.911850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-132a3159-a6d2-4d5e-a13b-66bd2f49e6d4 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827" status: 404 len: 111 microversion: 2.1 time: 0.028108 Jan 25 03:45:25.912360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 686/1299] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:45:25 2022] GET /compute/v2.1/servers/447c6612-9f1b-4064-b6ed-7ee5dc89f827 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:45:25.920285 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-84fff148-4e1a-4130-adff-3ff0f5cbc526 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] Calling method '.version_select at 0x7f33a8fbeee0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:45:25.923644 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: ERROR oslo.messaging._drivers.impl_rabbit [None req-84fff148-4e1a-4130-adff-3ff0f5cbc526 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [65fba4d6-14f0-4545-acf8-4eb17a34039a] AMQP server on 10.222.0.115:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 25 03:45:26.931450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [None req-84fff148-4e1a-4130-adff-3ff0f5cbc526 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] [65fba4d6-14f0-4545-acf8-4eb17a34039a] Reconnected to AMQP server on 10.222.0.115:5672 via [amqp] client with port 35478. Jan 25 03:45:27.012552 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-84fff148-4e1a-4130-adff-3ff0f5cbc526 tempest-TestMinimumBasicScenario-1083941949 tempest-TestMinimumBasicScenario-1083941949-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-193037485" status: 202 len: 0 microversion: 2.1 time: 1.094637 Jan 25 03:45:27.013158 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 614/1300] 10.222.0.115 () {58 vars in 1273 bytes} [Tue Jan 25 03:45:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-193037485 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:45:41.113550 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:45:41.114122 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:45:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:46:19.222876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-06b03f48-de93-4168-9da1-a835478f25b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:19.223802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-06b03f48-de93-4168-9da1-a835478f25b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:19.230012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06b03f48-de93-4168-9da1-a835478f25b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:19.230469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06b03f48-de93-4168-9da1-a835478f25b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:19.231270 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06b03f48-de93-4168-9da1-a835478f25b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:19.231709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-06b03f48-de93-4168-9da1-a835478f25b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:19.260847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-06b03f48-de93-4168-9da1-a835478f25b8 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042320 Jan 25 03:46:19.261378 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 687/1301] 10.222.0.115 () {60 vars in 1347 bytes} [Tue Jan 25 03:46:19 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:19.318119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:19.318665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:19.324338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:19.324790 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:19.325568 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:19.326009 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:19.350034 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:46:19.574837 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b40d3126-9930-4426-9db1-de554298ef81 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 204 len: 0 microversion: 2.20 time: 0.262023 Jan 25 03:46:19.575388 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 615/1302] 10.222.0.115 () {60 vars in 1284 bytes} [Tue Jan 25 03:46:19 2022] DELETE /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 25 03:46:19.591749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:19.592359 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:19.598377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:19.598825 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:19.599629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:19.600072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:19.894202 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:19.901965 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:19.903488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:19.904632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-10fef4e8-1c87-4672-bbf3-f6cf1fb1e4f0 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.316526 Jan 25 03:46:19.905185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 688/1303] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:46:19 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:46:20.923931 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:20.924647 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:20.930874 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:20.931347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:20.932117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:20.932549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:21.123897 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:21.131737 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:21.133211 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:21.134350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-12c45ca6-9dc6-46b3-89ca-c5a5790a5b7f tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.215246 Jan 25 03:46:21.134903 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 616/1304] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:46:20 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:46:22.152044 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:22.152666 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:22.159793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:22.160255 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:22.161046 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:22.161495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:22.536191 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:22.544372 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:22.545916 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:22.547236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-318ad2c6-de31-4b83-a31a-edeeb1528c93 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1724 microversion: 2.20 time: 0.398805 Jan 25 03:46:22.547827 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 689/1305] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:46:22 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:46:22.618172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-f450381d-d35b-47fc-a886-761dbcbadd78 req-448ac0fd-a52c-49e5-bcd9-fa99759738bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b8302b8-b04f-40ea-a9ff-2461018e7962", "name": "network-vif-deleted", "tag": "9f6cee72-9dab-452f-955a-9024f4b6b9f4"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:22.620575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:22.620575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:46:22.628089 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-f450381d-d35b-47fc-a886-761dbcbadd78 req-448ac0fd-a52c-49e5-bcd9-fa99759738bb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:22.628595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-f450381d-d35b-47fc-a886-761dbcbadd78 req-448ac0fd-a52c-49e5-bcd9-fa99759738bb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:22.644053 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-f450381d-d35b-47fc-a886-761dbcbadd78 req-448ac0fd-a52c-49e5-bcd9-fa99759738bb service nova] Creating event network-vif-deleted:9f6cee72-9dab-452f-955a-9024f4b6b9f4 for instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 on hv-cinder-81901 Jan 25 03:46:22.649342 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-f450381d-d35b-47fc-a886-761dbcbadd78 req-448ac0fd-a52c-49e5-bcd9-fa99759738bb service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034864 Jan 25 03:46:22.650148 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 617/1306] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:46:23.566169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:23.566763 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:23.573118 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:23.573570 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:23.574343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:23.574778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:23.608489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:23.608865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:23.609304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lazy-loading 'fault' on Instance uuid 6b8302b8-b04f-40ea-a9ff-2461018e7962 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:46:23.648242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:23.655694 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:23.657814 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8f0cd1ec82a347f2babd996424cbb0b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33c5e2c89460402987c96eb3c3340a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:23.658982 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4425d011-bdac-4891-9bde-ed3834124af2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 200 len: 1374 microversion: 2.20 time: 0.097314 Jan 25 03:46:23.659568 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 690/1307] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:46:23 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 1374 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 25 03:46:24.678640 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:24.679370 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:24.685690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:24.686145 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:24.688641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:24.688641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:24.700389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] HTTP exception thrown: Instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 could not be found. Jan 25 03:46:24.700971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Returning 404 to user: Instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:46:24.701781 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-51712a75-c616-4ed2-9264-5d4c1b72c112 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 404 len: 111 microversion: 2.20 time: 0.028637 Jan 25 03:46:24.702318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 618/1308] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:46:24 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:46:24.711167 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ff8b8b9a-17a6-4234-bd95-1813d12c258e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '.version_select at 0x7f33aac13820>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:24.795161 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ff8b8b9a-17a6-4234-bd95-1813d12c258e tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113852080" status: 204 len: 0 microversion: 2.20 time: 0.087628 Jan 25 03:46:24.795780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 691/1309] 10.222.0.115 () {60 vars in 1266 bytes} [Tue Jan 25 03:46:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1113852080 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 25 03:46:25.640808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-248767864", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1048410455", "security_groups": [{"name": "tempest-secgroup-smoke-63611146"}], "block_device_mapping_v2": [{"uuid": "8e2a24e9-daa3-4ed7-b486-6cd39b47a8fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ff74d41-8997-4f13-a353-f1aafd7e012e"}]}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:25.750738 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] validate_networks() for [('0ff74d41-8997-4f13-a353-f1aafd7e012e', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:46:26.198021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:46:26.198470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:46:26.198937 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:46:26.199367 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:46:26.199776 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:46:26.209236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:26.209690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:26.210517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:26.210957 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:26.227679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for project 0fe72d0d8d144438a671aac4e939c693. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:46:26.231617 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Getting quotas for user 792e6b0c7c4946ed88fbc454b1779485 and project 0fe72d0d8d144438a671aac4e939c693. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:46:26.285009 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:46:26.287141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e2a24e9-daa3-4ed7-b486-6cd39b47a8fa',volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:46:26.709165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-53ceec13-0f18-46cb-8b33-c3a02b2ecb20 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.071982 Jan 25 03:46:26.709825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 619/1310] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:46:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:46:26.720045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3b819175-e218-471c-87a3-ae94e5baccf4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:26.720649 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3b819175-e218-471c-87a3-ae94e5baccf4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:26.776568 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3b819175-e218-471c-87a3-ae94e5baccf4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:26.783237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3b819175-e218-471c-87a3-ae94e5baccf4 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1097 microversion: 2.1 time: 0.067314 Jan 25 03:46:26.784385 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 692/1311] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:26 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1097 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:26.861230 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:26.861782 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:26.870514 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:26.870907 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:26.871721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:26.872165 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:26.885948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] HTTP exception thrown: Instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 could not be found. Jan 25 03:46:26.886537 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Returning 404 to user: Instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:46:26.887383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9e8d056b-8892-46b5-9c19-4d68213fe270 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 404 len: 111 microversion: 2.20 time: 0.029811 Jan 25 03:46:26.887921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 620/1312] 10.222.0.115 () {60 vars in 1284 bytes} [Tue Jan 25 03:46:26 2022] DELETE /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:46:26.896551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:26.897164 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: 6b8302b8-b04f-40ea-a9ff-2461018e7962] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:26.903221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:26.903876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:26.904663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:26.905304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:26.918597 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] HTTP exception thrown: Instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 could not be found. Jan 25 03:46:26.919234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Returning 404 to user: Instance 6b8302b8-b04f-40ea-a9ff-2461018e7962 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:46:26.920076 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-58b274f4-2000-4d27-8477-77a170a59db2 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962" status: 404 len: 111 microversion: 2.20 time: 0.027970 Jan 25 03:46:26.920624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 693/1313] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:46:26 2022] GET /compute/v2.1/servers/6b8302b8-b04f-40ea-a9ff-2461018e7962 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:46:27.801766 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:27.802302 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:27.808883 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:27.809451 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:27.810234 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:27.810676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:27.869856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:27.877944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0cedc6e2-4f22-40e5-8641-e3de9d6b9f12 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1147 microversion: 2.1 time: 0.080304 Jan 25 03:46:27.878530 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 621/1314] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:27 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1147 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:28.188403 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:28.192053 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:28.195341 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:28.195807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:28.196586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:28.197032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:28.211916 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] HTTP exception thrown: Instance b5c1179f-67c0-4198-8933-7cabe5c964f3 could not be found. Jan 25 03:46:28.212505 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Returning 404 to user: Instance b5c1179f-67c0-4198-8933-7cabe5c964f3 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:46:28.213329 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e91d671b-4dc4-4078-8470-970ff82299d1 tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "DELETE /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 404 len: 111 microversion: 2.20 time: 0.028694 Jan 25 03:46:28.213857 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 694/1315] 10.222.0.115 () {60 vars in 1284 bytes} [Tue Jan 25 03:46:28 2022] DELETE /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:46:28.222313 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:28.222990 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] [instance: b5c1179f-67c0-4198-8933-7cabe5c964f3] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:28.228822 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:28.229273 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:28.230046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:28.230482 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:28.243813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] HTTP exception thrown: Instance b5c1179f-67c0-4198-8933-7cabe5c964f3 could not be found. Jan 25 03:46:28.244395 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] Returning 404 to user: Instance b5c1179f-67c0-4198-8933-7cabe5c964f3 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:46:28.245200 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-aabba1dc-2dd6-4739-b20e-dd572bfdc9eb tempest-AttachVolumeShelveTestJSON-1335948593 tempest-AttachVolumeShelveTestJSON-1335948593-project] 10.222.0.115 "GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3" status: 404 len: 111 microversion: 2.20 time: 0.027277 Jan 25 03:46:28.245790 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 622/1316] 10.222.0.115 () {60 vars in 1281 bytes} [Tue Jan 25 03:46:28 2022] GET /compute/v2.1/servers/b5c1179f-67c0-4198-8933-7cabe5c964f3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 25 03:46:28.894535 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:28.895195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:28.901249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:28.901712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:28.902501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:28.902942 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:28.963015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:28.971501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c6b6f7db-efcf-4c63-9833-1202f9d09bb0 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1203 microversion: 2.1 time: 0.080338 Jan 25 03:46:28.972078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 695/1317] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:28 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1203 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:29.989824 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:29.992944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:30.001021 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:30.001476 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:30.002949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:30.003439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:30.086456 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:30.094922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-be3f0697-56fc-4171-a82a-887cf29358e7 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1213 microversion: 2.1 time: 0.109802 Jan 25 03:46:30.095523 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 623/1318] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:29 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:31.112158 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:31.113473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:31.121326 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:31.127628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:31.130200 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:31.135457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:31.362076 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:31.370793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a072c5fd-88fc-4808-93bb-304bcec87e6a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.262754 Jan 25 03:46:31.371407 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 696/1319] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:31 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:31.528001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-15e287f3-1017-40ed-951b-a15889939bb0 req-74aadeeb-8e83-48c3-be56-7c58622c5ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fc95ec-6950-4d1c-8a8e-8cd379ddc451", "tag": "9fc9a725-79a8-415e-b949-ee950a70e69e"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:31.529547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:31.529547 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:46:31.539981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-15e287f3-1017-40ed-951b-a15889939bb0 req-74aadeeb-8e83-48c3-be56-7c58622c5ab5 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:31.540698 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-15e287f3-1017-40ed-951b-a15889939bb0 req-74aadeeb-8e83-48c3-be56-7c58622c5ab5 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:31.558740 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-15e287f3-1017-40ed-951b-a15889939bb0 req-74aadeeb-8e83-48c3-be56-7c58622c5ab5 service nova] Creating event network-changed:9fc9a725-79a8-415e-b949-ee950a70e69e for instance 31fc95ec-6950-4d1c-8a8e-8cd379ddc451 on hv-cinder-81901 Jan 25 03:46:31.567946 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-15e287f3-1017-40ed-951b-a15889939bb0 req-74aadeeb-8e83-48c3-be56-7c58622c5ab5 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132033 Jan 25 03:46:31.568820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 624/1320] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:46:32.387237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:32.388482 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:32.395296 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:32.396077 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:32.397119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:32.397741 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:32.545116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:32.553578 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7c2489a5-1735-4f87-b79f-c395905c398a tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.169996 Jan 25 03:46:32.554169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 697/1321] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:32 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:33.571633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:33.572773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:33.579338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:33.579679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:33.581335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:33.581769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:33.714364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:33.722876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5f4cbcbe-a2d3-4dca-93b9-15ab84752b73 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.155972 Jan 25 03:46:33.725321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 625/1322] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:33 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:34.740687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:34.741302 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:34.747555 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:34.748010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:34.748793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:34.749273 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:34.937375 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:34.944961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-05e9e257-7310-404d-a425-e159004f148f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.208617 Jan 25 03:46:34.945536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 698/1323] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:34 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:35.962606 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:35.963351 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:35.970073 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:35.972166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:35.972166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:35.972166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:36.111947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:36.119740 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-50c4bdbe-af2a-4d9b-a4ef-833ccdcde41c tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.161691 Jan 25 03:46:36.120464 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 626/1324] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:35 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:37.139124 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:37.139965 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:37.147506 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:37.148048 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:37.148938 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:37.149459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:37.428516 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:37.436867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8c318542-4109-4d13-8fa9-4a57a234c7ca tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.302766 Jan 25 03:46:37.437443 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 699/1325] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:37 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:38.454520 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:38.455784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:38.462370 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:38.462879 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:38.463806 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:38.464335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:38.627986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:38.635576 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-aac176e8-6e35-4b84-b348-a7d4b7e664da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.185208 Jan 25 03:46:38.636147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 627/1326] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:38 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:39.652256 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:39.653047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:39.660661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:39.660661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:39.661911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:39.661911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:39.912791 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:39.935230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9e58515f-a66d-4564-8ba8-ca9898105f75 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.286566 Jan 25 03:46:39.936456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 700/1327] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:39 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:40.341058 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-60e4b3cf-eae2-4570-a8e8-5130ab3448b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'create', calling method: .version_select at 0x7f33aac160d0>, body: {"keypair": {"name": "tempest-keypair-2067210611"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:40.356701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-60e4b3cf-eae2-4570-a8e8-5130ab3448b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:46:40.360785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-60e4b3cf-eae2-4570-a8e8-5130ab3448b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for user 8a0f2bac18ad4e9191dc4fabea7c6e9f and project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:46:40.653290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-60e4b3cf-eae2-4570-a8e8-5130ab3448b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:46:40.657548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-60e4b3cf-eae2-4570-a8e8-5130ab3448b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for user 8a0f2bac18ad4e9191dc4fabea7c6e9f and project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:46:40.672815 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-60e4b3cf-eae2-4570-a8e8-5130ab3448b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.450589 Jan 25 03:46:40.674373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 628/1328] 10.222.0.115 () {60 vars in 1162 bytes} [Tue Jan 25 03:46:40 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:40.952970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:40.953681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:40.961652 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:40.962450 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:40.963581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:40.964347 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:41.109382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:41.118047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-30ebff6f-f2bb-45f4-8281-8848d30cf8f3 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.169134 Jan 25 03:46:41.118952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 701/1329] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:40 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:42.135943 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:42.136663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:42.144641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:42.146373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:42.146373 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:42.147013 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:42.267901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-abce2c2b-144f-4b64-a994-8e3d119c7eb2 req-6eddcfe6-27f1-4115-9d5e-0b21f5db56b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fc95ec-6950-4d1c-8a8e-8cd379ddc451", "name": "network-vif-plugged", "status": "completed", "tag": "9fc9a725-79a8-415e-b949-ee950a70e69e"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:42.270243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:42.270243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:46:42.278210 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-abce2c2b-144f-4b64-a994-8e3d119c7eb2 req-6eddcfe6-27f1-4115-9d5e-0b21f5db56b7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:42.278678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-abce2c2b-144f-4b64-a994-8e3d119c7eb2 req-6eddcfe6-27f1-4115-9d5e-0b21f5db56b7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:42.290623 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-abce2c2b-144f-4b64-a994-8e3d119c7eb2 req-6eddcfe6-27f1-4115-9d5e-0b21f5db56b7 service nova] Creating event network-vif-plugged:9fc9a725-79a8-415e-b949-ee950a70e69e for instance 31fc95ec-6950-4d1c-8a8e-8cd379ddc451 on hv-cinder-81901 Jan 25 03:46:42.296042 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-abce2c2b-144f-4b64-a994-8e3d119c7eb2 req-6eddcfe6-27f1-4115-9d5e-0b21f5db56b7 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Jan 25 03:46:42.297200 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 702/1330] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:46:42.317033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:42.324939 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c832db24-1013-477a-b7fb-7228d7bbcd87 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.193593 Jan 25 03:46:42.325513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 629/1331] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:42 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:43.354876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:43.354876 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:43.355866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-518878644", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e545c365-d10d-438c-b92f-53b0b77d7557"}], "security_groups": [{"name": "tempest-securitygroup--1823513719"}], "key_name": "tempest-keypair-2067210611", "user_data": "}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:43.362592 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:43.367817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:43.369089 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:43.369853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:43.473720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.network.neutron [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] validate_networks() for [('e545c365-d10d-438c-b92f-53b0b77d7557', None, None, None, None, None)] {{(pid=123362) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:46:43.536691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:43.544334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b6e1a5e9-5210-4469-975a-de779b62386d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1267 microversion: 2.1 time: 0.205880 Jan 25 03:46:43.545187 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 630/1332] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:43 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:43.913832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Flavor limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:46:43.914260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Image limits 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:46:43.914740 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Flavor pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:46:43.915181 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Image pref 0:0:0 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:46:43.915600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.virt.hardware [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:46:43.924981 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:43.925532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:43.926496 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:43.927049 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:43.945461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for project bbf2a4190655482593e7a860bbf16549. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:46:43.949509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for user 8a0f2bac18ad4e9191dc4fabea7c6e9f and project bbf2a4190655482593e7a860bbf16549. Resources: {'instances', 'cores', 'ram'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:46:43.961291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Going to run 1 instances... {{(pid=123362) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:46:43.963868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:46:44.118312 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-761dc82a-d09f-483f-a135-b55947680142 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.779790 Jan 25 03:46:44.118966 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 703/1333] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:46:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:46:44.129536 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bc17f342-5a19-444d-a351-7eaa3cb08d4d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:44.130366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bc17f342-5a19-444d-a351-7eaa3cb08d4d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:44.185644 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bc17f342-5a19-444d-a351-7eaa3cb08d4d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:44.196993 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bc17f342-5a19-444d-a351-7eaa3cb08d4d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1241 microversion: 2.1 time: 0.071733 Jan 25 03:46:44.197861 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 631/1334] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:44 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:44.562800 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:44.563455 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:44.570432 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:44.570886 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:44.571701 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:44.572147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:44.709740 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:44.717175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f3398eaa-6d20-4b17-a3aa-5e6439e9c3e9 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1455 microversion: 2.1 time: 0.158498 Jan 25 03:46:44.717742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 704/1335] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:44 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:44.733472 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:44.734087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:44.741023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:44.741479 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:44.742268 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:44.742708 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:44.880965 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:44.888317 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-83db0b80-6532-4756-be53-9b6a6fb3205d tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1455 microversion: 2.1 time: 0.158468 Jan 25 03:46:44.888888 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 632/1336] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:44 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:45.213678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:45.214515 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:45.221376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:45.221932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:45.222826 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:45.223554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:45.315975 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:45.329134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-57dde625-5f34-4e5d-8260-b6a3bad95b39 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1245 microversion: 2.1 time: 0.119044 Jan 25 03:46:45.329913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 705/1337] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:45 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:46.351840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:46.353425 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:46.360448 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:46.361246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:46.362047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:46.362488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:46.454671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:46.461977 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7a099267-6e85-4804-a84f-fab0a31ad9f5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1311 microversion: 2.1 time: 0.118901 Jan 25 03:46:46.462563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 633/1338] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:46 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:47.440193 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-25baf3cc-ed63-4819-b13a-005accc0a21e req-86c0d52b-caf6-47a3-a967-70aabbc409e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fc95ec-6950-4d1c-8a8e-8cd379ddc451", "tag": "9fc9a725-79a8-415e-b949-ee950a70e69e"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:47.443454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:47.443454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:46:47.459562 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-25baf3cc-ed63-4819-b13a-005accc0a21e req-86c0d52b-caf6-47a3-a967-70aabbc409e3 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:47.460022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-25baf3cc-ed63-4819-b13a-005accc0a21e req-86c0d52b-caf6-47a3-a967-70aabbc409e3 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:47.476498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-25baf3cc-ed63-4819-b13a-005accc0a21e req-86c0d52b-caf6-47a3-a967-70aabbc409e3 service nova] Creating event network-changed:9fc9a725-79a8-415e-b949-ee950a70e69e for instance 31fc95ec-6950-4d1c-8a8e-8cd379ddc451 on hv-cinder-81901 Jan 25 03:46:47.479038 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:47.479735 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:47.485060 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-25baf3cc-ed63-4819-b13a-005accc0a21e req-86c0d52b-caf6-47a3-a967-70aabbc409e3 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049778 Jan 25 03:46:47.485909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 706/1339] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:46:47.501082 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:47.501917 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:47.502849 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:47.503406 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:48.107887 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:48.116104 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-349926d5-e75b-4e80-b53b-0bef4fb34781 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.641565 Jan 25 03:46:48.119763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 634/1340] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:47 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:46:49.133829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:49.135233 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:49.140895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:49.141350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:49.142178 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:49.142867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:49.285309 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:49.293593 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-4752b11a-ea96-40df-8684-c36ee1e22856 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.164163 Jan 25 03:46:49.294196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 707/1341] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:49 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:49.529318 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-939e32cc-f291-4348-a289-fbe70af10c1f req-c5ee4f94-f9ec-4bdf-8d5e-68ecefe81633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ec9d94c-01db-458b-a8e9-df0d45bf666a", "tag": "e2b1c0da-6f9d-4323-8052-3159d350939c"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:49.530882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:49.530882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:46:49.539087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-939e32cc-f291-4348-a289-fbe70af10c1f req-c5ee4f94-f9ec-4bdf-8d5e-68ecefe81633 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:49.542718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-939e32cc-f291-4348-a289-fbe70af10c1f req-c5ee4f94-f9ec-4bdf-8d5e-68ecefe81633 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:49.550512 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-939e32cc-f291-4348-a289-fbe70af10c1f req-c5ee4f94-f9ec-4bdf-8d5e-68ecefe81633 service nova] Creating event network-changed:e2b1c0da-6f9d-4323-8052-3159d350939c for instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a on hv-cinder-81901 Jan 25 03:46:49.555616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-939e32cc-f291-4348-a289-fbe70af10c1f req-c5ee4f94-f9ec-4bdf-8d5e-68ecefe81633 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029828 Jan 25 03:46:49.556249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 635/1342] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:46:50.311104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:50.311725 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:50.318735 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:50.319235 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:50.320031 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:50.320484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:50.448867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:50.456305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e4ffabb4-800c-4e54-a1e9-4e6c883bc8e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.149124 Jan 25 03:46:50.456874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 708/1343] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:50 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:51.473976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:51.474692 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:51.480634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:51.484439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:51.484439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:51.484439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:51.722180 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:51.729535 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-02afaffe-9e0d-4dc1-8b83-84e12edb8643 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.260234 Jan 25 03:46:51.730327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 636/1344] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:51 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:52.021849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:52.026890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-e5ceb240-e70f-4343-9920-e9532aff3a7d req-ef2cd08f-4dc9-4788-87d1-7cc2b7eaa18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d", "tag": "b93b0fe2-4ab5-4c3c-81e5-39ac08ded566"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:52.028599 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:52.028599 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:46:52.029283 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:52.039688 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:52.042183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:52.042996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:52.045036 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-e5ceb240-e70f-4343-9920-e9532aff3a7d req-ef2cd08f-4dc9-4788-87d1-7cc2b7eaa18f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:52.045484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-e5ceb240-e70f-4343-9920-e9532aff3a7d req-ef2cd08f-4dc9-4788-87d1-7cc2b7eaa18f service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:52.047867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:52.065330 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-e5ceb240-e70f-4343-9920-e9532aff3a7d req-ef2cd08f-4dc9-4788-87d1-7cc2b7eaa18f service nova] Creating event network-changed:b93b0fe2-4ab5-4c3c-81e5-39ac08ded566 for instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d on hv-cinder-81901 Jan 25 03:46:52.072361 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-e5ceb240-e70f-4343-9920-e9532aff3a7d req-ef2cd08f-4dc9-4788-87d1-7cc2b7eaa18f service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048940 Jan 25 03:46:52.073067 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 637/1345] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:46:52.081570 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:46:52.383113 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6c374f96-b2b7-4d98-a82a-5cf9f193150c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "DELETE /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 204 len: 0 microversion: 2.1 time: 0.364770 Jan 25 03:46:52.384010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 709/1346] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:46:52 2022] DELETE /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:46:52.392928 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:52.393791 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:52.399990 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:52.400526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:52.401382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:52.401897 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:52.621416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:52.630235 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-28bcc865-0c38-4102-a50a-3c43f4ebe6e1 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1571 microversion: 2.1 time: 0.241800 Jan 25 03:46:52.630927 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 638/1347] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:52 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1571 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:52.760599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:52.761205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:52.768189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:52.768662 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:52.769464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:52.769909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:52.924300 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:52.932420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d215d302-bd7e-49e7-85a1-8d2a07d7b303 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.178529 Jan 25 03:46:52.933015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 710/1348] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:52 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:53.647688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:53.648301 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:53.654534 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:53.654987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:53.655875 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:53.656245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:53.784888 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:53.792357 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-63b47ea6-ef20-490b-82e6-3c02d8f95865 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1452 microversion: 2.1 time: 0.148342 Jan 25 03:46:53.792928 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 639/1349] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:53 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:53.949371 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:53.950232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:53.956661 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:53.957117 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:53.957904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:53.958344 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:54.089806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:54.100706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f2235680-0d3f-4f21-bdb5-fb3e0dad36e1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.154975 Jan 25 03:46:54.106846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 711/1350] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:53 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:54.809548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:54.810077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:54.817172 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:54.817602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:54.818369 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:54.818798 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:54.895821 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:54.903259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e8cafd1e-eaf3-4b65-a0c6-e368f82067e8 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1384 microversion: 2.1 time: 0.097705 Jan 25 03:46:54.903831 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 640/1351] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:54 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1384 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:54.942832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-05fa5934-105c-42c9-8aaf-d680e9aa5bb4 req-1ce12772-777d-4a47-8a55-bb68c940ce66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d", "name": "network-vif-deleted", "tag": "b93b0fe2-4ab5-4c3c-81e5-39ac08ded566"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:54.944475 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:54.944475 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:46:54.951134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-05fa5934-105c-42c9-8aaf-d680e9aa5bb4 req-1ce12772-777d-4a47-8a55-bb68c940ce66 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:54.951714 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-05fa5934-105c-42c9-8aaf-d680e9aa5bb4 req-1ce12772-777d-4a47-8a55-bb68c940ce66 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:54.962391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-05fa5934-105c-42c9-8aaf-d680e9aa5bb4 req-1ce12772-777d-4a47-8a55-bb68c940ce66 service nova] Creating event network-vif-deleted:b93b0fe2-4ab5-4c3c-81e5-39ac08ded566 for instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d on hv-cinder-81901 Jan 25 03:46:54.967174 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-05fa5934-105c-42c9-8aaf-d680e9aa5bb4 req-1ce12772-777d-4a47-8a55-bb68c940ce66 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028846 Jan 25 03:46:54.967940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 712/1352] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:46:55.117749 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:55.118350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:55.124145 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:55.124586 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:55.125352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:55.125798 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:55.264497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:55.272924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4ff13d4f-eea6-4f19-8e69-550a4f6956dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.158847 Jan 25 03:46:55.273510 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 641/1353] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:55 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:55.920485 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:55.921104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:55.927151 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:55.927702 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:55.928469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:55.928901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:55.960301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:55.960939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:55.961214 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lazy-loading 'fault' on Instance uuid 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:46:56.000238 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895b57e29c85419eaae67144c0da86ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5820f90cd1d1413e9885c9ec8005f384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:56.007927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-da308d42-bfd1-4b42-9787-5b88eb9c226c tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 200 len: 1227 microversion: 2.1 time: 0.091711 Jan 25 03:46:56.008519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 713/1354] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:55 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 1227 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:56.232935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-4c150743-659d-41d4-b067-e480864636d1 req-01718392-34b9-468f-871d-fe62ef658c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec9d94c-01db-458b-a8e9-df0d45bf666a", "name": "network-vif-plugged", "status": "completed", "tag": "e2b1c0da-6f9d-4323-8052-3159d350939c"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:46:56.234514 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:46:56.234514 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:46:56.241804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4c150743-659d-41d4-b067-e480864636d1 req-01718392-34b9-468f-871d-fe62ef658c0c service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:56.242242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4c150743-659d-41d4-b067-e480864636d1 req-01718392-34b9-468f-871d-fe62ef658c0c service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:56.253880 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-4c150743-659d-41d4-b067-e480864636d1 req-01718392-34b9-468f-871d-fe62ef658c0c service nova] Creating event network-vif-plugged:e2b1c0da-6f9d-4323-8052-3159d350939c for instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a on hv-cinder-81901 Jan 25 03:46:56.258719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-4c150743-659d-41d4-b067-e480864636d1 req-01718392-34b9-468f-871d-fe62ef658c0c service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086801 Jan 25 03:46:56.259416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 642/1355] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:46:56.290187 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:56.290804 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:56.296630 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:56.297103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:56.297874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:56.298998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:56.441088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:56.448481 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-72d7fbae-734d-4fc6-8908-7cc0a1288adc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.161933 Jan 25 03:46:56.449048 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 714/1356] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:56 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:57.026267 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:57.026925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] [instance: 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:57.033940 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:57.034391 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:57.035191 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:57.035631 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:57.048432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] HTTP exception thrown: Instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d could not be found. Jan 25 03:46:57.049174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Returning 404 to user: Instance 7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:46:57.049973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9dcc330a-48fd-4dc4-abc1-cf793af4b552 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d" status: 404 len: 111 microversion: 2.1 time: 0.027967 Jan 25 03:46:57.050498 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 643/1357] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:57 2022] GET /compute/v2.1/servers/7d22aaa8-ddc5-4e34-9ed6-e52a8d1e6f2d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:46:57.298217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ebe3c112-fff3-4ad9-8a26-6b9b360e0d82 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] Calling method '.version_select at 0x7f33a86905e0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:57.389134 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ebe3c112-fff3-4ad9-8a26-6b9b360e0d82 tempest-TestShelveInstance-855419403 tempest-TestShelveInstance-855419403-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-698612597" status: 202 len: 0 microversion: 2.1 time: 0.094576 Jan 25 03:46:57.389732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 715/1358] 10.222.0.115 () {58 vars in 1255 bytes} [Tue Jan 25 03:46:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-698612597 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:46:57.464550 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:57.465169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:57.473085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:57.473987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:57.475805 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:57.476978 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:57.629999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:57.637426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b53216fe-914c-49af-957f-303eb6135a92 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1367 microversion: 2.1 time: 0.176769 Jan 25 03:46:57.637992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 644/1359] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:57 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:46:58.654912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:58.655643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:58.662879 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:58.663367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:58.664180 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:58.664628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:58.943109 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:46:58.950657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ca2f865c-eea6-447e-8ab0-169aeed73346 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1553 microversion: 2.1 time: 0.299990 Jan 25 03:46:58.951268 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 716/1360] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:46:58 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1553 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:46:58.968721 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ea4fcae9-27ad-4427-8258-683ec9fbe0ae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:46:58.969278 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ea4fcae9-27ad-4427-8258-683ec9fbe0ae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:46:58.975882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ea4fcae9-27ad-4427-8258-683ec9fbe0ae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:58.976338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ea4fcae9-27ad-4427-8258-683ec9fbe0ae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:58.977119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ea4fcae9-27ad-4427-8258-683ec9fbe0ae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:46:58.977555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ea4fcae9-27ad-4427-8258-683ec9fbe0ae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:46:59.055865 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ea4fcae9-27ad-4427-8258-683ec9fbe0ae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090831 Jan 25 03:46:59.056488 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 645/1361] 10.222.0.115 () {58 vars in 1279 bytes} [Tue Jan 25 03:46:58 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:47:00.086900 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-40b6be45-c10d-4abf-9033-f1068fedc4e9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:00.087845 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-40b6be45-c10d-4abf-9033-f1068fedc4e9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:00.090255 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-7d449603-d02b-4088-b4ee-5978e574b20d req-773f32a0-84a1-4db1-bcc3-b729b695c25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ec9d94c-01db-458b-a8e9-df0d45bf666a", "tag": "e2b1c0da-6f9d-4323-8052-3159d350939c"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:00.092475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:47:00.092475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:47:00.094171 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40b6be45-c10d-4abf-9033-f1068fedc4e9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:00.095671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40b6be45-c10d-4abf-9033-f1068fedc4e9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:00.097138 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40b6be45-c10d-4abf-9033-f1068fedc4e9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:00.097807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-40b6be45-c10d-4abf-9033-f1068fedc4e9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:00.102002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-7d449603-d02b-4088-b4ee-5978e574b20d req-773f32a0-84a1-4db1-bcc3-b729b695c25a service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:00.102660 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-7d449603-d02b-4088-b4ee-5978e574b20d req-773f32a0-84a1-4db1-bcc3-b729b695c25a service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:00.116155 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-7d449603-d02b-4088-b4ee-5978e574b20d req-773f32a0-84a1-4db1-bcc3-b729b695c25a service nova] Creating event network-changed:e2b1c0da-6f9d-4323-8052-3159d350939c for instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a on hv-cinder-81901 Jan 25 03:47:00.121793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-7d449603-d02b-4088-b4ee-5978e574b20d req-773f32a0-84a1-4db1-bcc3-b729b695c25a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036236 Jan 25 03:47:00.123032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 646/1362] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:47:00.206192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-40b6be45-c10d-4abf-9033-f1068fedc4e9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.122720 Jan 25 03:47:00.214520 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 717/1363] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:00 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:01.225455 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5d605521-226e-4441-95c3-5d80dc0eceba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:01.227010 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5d605521-226e-4441-95c3-5d80dc0eceba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:01.234334 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d605521-226e-4441-95c3-5d80dc0eceba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:01.234792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d605521-226e-4441-95c3-5d80dc0eceba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:01.237211 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d605521-226e-4441-95c3-5d80dc0eceba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:01.237838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5d605521-226e-4441-95c3-5d80dc0eceba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:01.346475 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5d605521-226e-4441-95c3-5d80dc0eceba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.127991 Jan 25 03:47:01.350382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 647/1364] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:01 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:02.358640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-701a4306-e409-4229-9bd1-71037b0e7b2f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:02.359691 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-701a4306-e409-4229-9bd1-71037b0e7b2f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:02.367954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-701a4306-e409-4229-9bd1-71037b0e7b2f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:02.369537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-701a4306-e409-4229-9bd1-71037b0e7b2f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:02.371230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-701a4306-e409-4229-9bd1-71037b0e7b2f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:02.372386 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-701a4306-e409-4229-9bd1-71037b0e7b2f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:02.457525 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-701a4306-e409-4229-9bd1-71037b0e7b2f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.102936 Jan 25 03:47:02.460406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 718/1365] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:02 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:03.468788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a046d484-e2e5-48e5-b07e-c2f95be0049c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:03.470299 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a046d484-e2e5-48e5-b07e-c2f95be0049c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:03.477257 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a046d484-e2e5-48e5-b07e-c2f95be0049c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:03.477704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a046d484-e2e5-48e5-b07e-c2f95be0049c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:03.478482 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a046d484-e2e5-48e5-b07e-c2f95be0049c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:03.479132 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a046d484-e2e5-48e5-b07e-c2f95be0049c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:03.573967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a046d484-e2e5-48e5-b07e-c2f95be0049c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.108940 Jan 25 03:47:03.577066 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 648/1366] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:03 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:04.590628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-57080158-ebce-40a5-9ef1-abb344e05d38 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:04.591805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-57080158-ebce-40a5-9ef1-abb344e05d38 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:04.601960 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57080158-ebce-40a5-9ef1-abb344e05d38 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:04.609397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57080158-ebce-40a5-9ef1-abb344e05d38 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:04.609397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57080158-ebce-40a5-9ef1-abb344e05d38 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:04.615659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-57080158-ebce-40a5-9ef1-abb344e05d38 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:04.708325 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-57080158-ebce-40a5-9ef1-abb344e05d38 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.125679 Jan 25 03:47:04.711600 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 719/1367] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:04 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:05.719372 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-490be346-ea76-43dc-a042-80f0568c7834 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:05.721043 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-490be346-ea76-43dc-a042-80f0568c7834 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:05.728103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-490be346-ea76-43dc-a042-80f0568c7834 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:05.728553 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-490be346-ea76-43dc-a042-80f0568c7834 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:05.729336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-490be346-ea76-43dc-a042-80f0568c7834 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:05.729769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-490be346-ea76-43dc-a042-80f0568c7834 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:05.818349 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-490be346-ea76-43dc-a042-80f0568c7834 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.102906 Jan 25 03:47:05.821445 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 649/1368] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:05 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:06.828700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-edd689d2-be08-4206-b00a-1fea46cc9d2e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:06.830518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-edd689d2-be08-4206-b00a-1fea46cc9d2e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:06.837434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edd689d2-be08-4206-b00a-1fea46cc9d2e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:06.837896 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edd689d2-be08-4206-b00a-1fea46cc9d2e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:06.838686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edd689d2-be08-4206-b00a-1fea46cc9d2e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:06.839156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-edd689d2-be08-4206-b00a-1fea46cc9d2e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:06.923855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-edd689d2-be08-4206-b00a-1fea46cc9d2e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.098844 Jan 25 03:47:06.927093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 720/1369] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:06 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:07.942949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-96373611-c683-4a26-83a4-12cc6c8b2a93 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:07.942949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-96373611-c683-4a26-83a4-12cc6c8b2a93 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:07.943762 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96373611-c683-4a26-83a4-12cc6c8b2a93 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:07.944210 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96373611-c683-4a26-83a4-12cc6c8b2a93 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:07.944991 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96373611-c683-4a26-83a4-12cc6c8b2a93 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:07.945427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-96373611-c683-4a26-83a4-12cc6c8b2a93 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:08.030521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-96373611-c683-4a26-83a4-12cc6c8b2a93 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.099203 Jan 25 03:47:08.031651 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 650/1370] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:07 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:09.042933 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b5ab7765-858d-4c2b-bcb8-5bd9fe955dd9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:09.043950 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b5ab7765-858d-4c2b-bcb8-5bd9fe955dd9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:09.051246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b5ab7765-858d-4c2b-bcb8-5bd9fe955dd9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:09.051698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b5ab7765-858d-4c2b-bcb8-5bd9fe955dd9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:09.052464 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b5ab7765-858d-4c2b-bcb8-5bd9fe955dd9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:09.052900 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b5ab7765-858d-4c2b-bcb8-5bd9fe955dd9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:09.147603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b5ab7765-858d-4c2b-bcb8-5bd9fe955dd9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.108067 Jan 25 03:47:09.149175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 721/1371] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:09 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:10.158917 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5a054b07-67a5-47fa-a2aa-a97730ca974e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:10.159971 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5a054b07-67a5-47fa-a2aa-a97730ca974e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:10.166812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5a054b07-67a5-47fa-a2aa-a97730ca974e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:10.167301 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5a054b07-67a5-47fa-a2aa-a97730ca974e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:10.168082 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5a054b07-67a5-47fa-a2aa-a97730ca974e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:10.168521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5a054b07-67a5-47fa-a2aa-a97730ca974e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:10.255169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5a054b07-67a5-47fa-a2aa-a97730ca974e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 14 microversion: 2.1 time: 0.100646 Jan 25 03:47:10.255805 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 651/1372] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:10 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:47:11.267306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3f08e200-8c36-497e-b71e-f684ec1a8cc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:11.268309 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3f08e200-8c36-497e-b71e-f684ec1a8cc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:11.275075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f08e200-8c36-497e-b71e-f684ec1a8cc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:11.275559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f08e200-8c36-497e-b71e-f684ec1a8cc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:11.276342 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f08e200-8c36-497e-b71e-f684ec1a8cc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:11.276784 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3f08e200-8c36-497e-b71e-f684ec1a8cc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:11.368715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3f08e200-8c36-497e-b71e-f684ec1a8cc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 8104 microversion: 2.1 time: 0.105999 Jan 25 03:47:11.369305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 722/1373] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:11 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 8104 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:47:12.379573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f2b44898-87ac-4e41-ae93-800574dc5a54 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:12.381533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f2b44898-87ac-4e41-ae93-800574dc5a54 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:12.387387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2b44898-87ac-4e41-ae93-800574dc5a54 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:12.387838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2b44898-87ac-4e41-ae93-800574dc5a54 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:12.388646 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2b44898-87ac-4e41-ae93-800574dc5a54 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:12.389085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f2b44898-87ac-4e41-ae93-800574dc5a54 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:12.491005 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f2b44898-87ac-4e41-ae93-800574dc5a54 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 16196 microversion: 2.1 time: 0.115369 Jan 25 03:47:12.491704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 652/1374] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:12 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 16196 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:13.503412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-118cbe48-993e-4b89-afb3-b0ce23a714c0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:13.504429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-118cbe48-993e-4b89-afb3-b0ce23a714c0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:13.511230 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-118cbe48-993e-4b89-afb3-b0ce23a714c0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:13.511685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-118cbe48-993e-4b89-afb3-b0ce23a714c0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:13.512454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-118cbe48-993e-4b89-afb3-b0ce23a714c0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:13.512889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-118cbe48-993e-4b89-afb3-b0ce23a714c0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:13.606395 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-118cbe48-993e-4b89-afb3-b0ce23a714c0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 18561 microversion: 2.1 time: 0.107679 Jan 25 03:47:13.607033 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 723/1375] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:13 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 18561 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:14.618696 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3f9775b9-26ef-4403-ab64-9f1f86c21086 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:14.619663 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3f9775b9-26ef-4403-ab64-9f1f86c21086 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:14.626491 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3f9775b9-26ef-4403-ab64-9f1f86c21086 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:14.626938 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3f9775b9-26ef-4403-ab64-9f1f86c21086 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:14.627736 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3f9775b9-26ef-4403-ab64-9f1f86c21086 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:14.628171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3f9775b9-26ef-4403-ab64-9f1f86c21086 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:14.723118 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3f9775b9-26ef-4403-ab64-9f1f86c21086 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 20997 microversion: 2.1 time: 0.108335 Jan 25 03:47:14.723764 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 653/1376] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:14 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 20997 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:15.734557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-31ca5c27-07e8-4a70-8ed3-17cb8d4dbfb5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:15.736403 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-31ca5c27-07e8-4a70-8ed3-17cb8d4dbfb5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:15.743310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31ca5c27-07e8-4a70-8ed3-17cb8d4dbfb5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:15.743753 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31ca5c27-07e8-4a70-8ed3-17cb8d4dbfb5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:15.744526 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31ca5c27-07e8-4a70-8ed3-17cb8d4dbfb5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:15.744967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31ca5c27-07e8-4a70-8ed3-17cb8d4dbfb5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:15.835045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-31ca5c27-07e8-4a70-8ed3-17cb8d4dbfb5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 22987 microversion: 2.1 time: 0.104391 Jan 25 03:47:15.835793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 724/1377] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:15 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 22987 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:16.847708 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-43d83a5c-9435-485d-900e-c8aa18234517 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:16.848733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-43d83a5c-9435-485d-900e-c8aa18234517 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:16.855596 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43d83a5c-9435-485d-900e-c8aa18234517 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:16.856046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43d83a5c-9435-485d-900e-c8aa18234517 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:16.856808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43d83a5c-9435-485d-900e-c8aa18234517 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:16.857237 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43d83a5c-9435-485d-900e-c8aa18234517 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:16.947998 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-43d83a5c-9435-485d-900e-c8aa18234517 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 24051 microversion: 2.1 time: 0.104908 Jan 25 03:47:16.948643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 654/1378] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:16 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 24051 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:17.960467 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-86ec1430-1de6-477a-a3f7-9d710463fdf2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:17.961482 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-86ec1430-1de6-477a-a3f7-9d710463fdf2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:17.968284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86ec1430-1de6-477a-a3f7-9d710463fdf2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:17.968731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86ec1430-1de6-477a-a3f7-9d710463fdf2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:17.970094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86ec1430-1de6-477a-a3f7-9d710463fdf2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:17.970521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86ec1430-1de6-477a-a3f7-9d710463fdf2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:18.068143 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-86ec1430-1de6-477a-a3f7-9d710463fdf2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 25804 microversion: 2.1 time: 0.111614 Jan 25 03:47:18.068794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 725/1379] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:17 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 25804 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:19.081129 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6672cf6c-d271-4c7a-b575-1dec9d5abfa9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:19.082139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6672cf6c-d271-4c7a-b575-1dec9d5abfa9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:19.089018 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6672cf6c-d271-4c7a-b575-1dec9d5abfa9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:19.089476 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6672cf6c-d271-4c7a-b575-1dec9d5abfa9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:19.090252 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6672cf6c-d271-4c7a-b575-1dec9d5abfa9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:19.090713 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6672cf6c-d271-4c7a-b575-1dec9d5abfa9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:19.187164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6672cf6c-d271-4c7a-b575-1dec9d5abfa9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 27135 microversion: 2.1 time: 0.110730 Jan 25 03:47:19.188354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 655/1380] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:19 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 27135 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:20.199022 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-b8547ff6-46a5-4d4a-bd02-71b268e97b14 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:20.239615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-b8547ff6-46a5-4d4a-bd02-71b268e97b14 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:20.239615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8547ff6-46a5-4d4a-bd02-71b268e97b14 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:20.239615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8547ff6-46a5-4d4a-bd02-71b268e97b14 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:20.239615 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8547ff6-46a5-4d4a-bd02-71b268e97b14 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:20.240041 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-b8547ff6-46a5-4d4a-bd02-71b268e97b14 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:20.323120 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-b8547ff6-46a5-4d4a-bd02-71b268e97b14 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 27738 microversion: 2.1 time: 0.127984 Jan 25 03:47:20.324264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 726/1381] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:20 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 27738 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:21.335174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-61f5099b-ca79-42b4-8768-3a87d2e5f7e8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:21.336174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-61f5099b-ca79-42b4-8768-3a87d2e5f7e8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:21.343035 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61f5099b-ca79-42b4-8768-3a87d2e5f7e8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:21.343513 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61f5099b-ca79-42b4-8768-3a87d2e5f7e8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:21.344855 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61f5099b-ca79-42b4-8768-3a87d2e5f7e8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:21.345363 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-61f5099b-ca79-42b4-8768-3a87d2e5f7e8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:21.439556 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-61f5099b-ca79-42b4-8768-3a87d2e5f7e8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28085 microversion: 2.1 time: 0.108224 Jan 25 03:47:21.440208 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 656/1382] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:21 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28085 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:22.451758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6dda0eb9-3503-4749-b040-62c6903c70a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:22.452750 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6dda0eb9-3503-4749-b040-62c6903c70a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:22.460183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6dda0eb9-3503-4749-b040-62c6903c70a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:22.460643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6dda0eb9-3503-4749-b040-62c6903c70a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:22.461415 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6dda0eb9-3503-4749-b040-62c6903c70a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:22.461874 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6dda0eb9-3503-4749-b040-62c6903c70a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:22.559479 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6dda0eb9-3503-4749-b040-62c6903c70a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.111754 Jan 25 03:47:22.560145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 727/1383] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:22 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:23.572460 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7c8da687-15f7-40ec-b960-98beacb03d74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:23.573468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7c8da687-15f7-40ec-b960-98beacb03d74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:23.580380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7c8da687-15f7-40ec-b960-98beacb03d74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:23.580827 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7c8da687-15f7-40ec-b960-98beacb03d74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:23.581602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7c8da687-15f7-40ec-b960-98beacb03d74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:23.582044 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7c8da687-15f7-40ec-b960-98beacb03d74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:23.668433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7c8da687-15f7-40ec-b960-98beacb03d74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.099899 Jan 25 03:47:23.669071 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 657/1384] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:23 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:24.681165 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-86522f3b-a669-4855-aef8-b4cb0afedf6b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:24.682177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-86522f3b-a669-4855-aef8-b4cb0afedf6b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:24.689819 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86522f3b-a669-4855-aef8-b4cb0afedf6b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:24.690283 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86522f3b-a669-4855-aef8-b4cb0afedf6b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:24.691094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86522f3b-a669-4855-aef8-b4cb0afedf6b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:24.691556 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-86522f3b-a669-4855-aef8-b4cb0afedf6b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:24.772964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-86522f3b-a669-4855-aef8-b4cb0afedf6b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.096035 Jan 25 03:47:24.773607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 728/1385] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:24 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:25.785761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-368effd7-ea95-4b90-9221-26abfb85a8a7 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:25.786763 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-368effd7-ea95-4b90-9221-26abfb85a8a7 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:25.793760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368effd7-ea95-4b90-9221-26abfb85a8a7 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:25.794242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368effd7-ea95-4b90-9221-26abfb85a8a7 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:25.795035 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368effd7-ea95-4b90-9221-26abfb85a8a7 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:25.795497 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-368effd7-ea95-4b90-9221-26abfb85a8a7 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:25.895628 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-368effd7-ea95-4b90-9221-26abfb85a8a7 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.114488 Jan 25 03:47:25.896264 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 658/1386] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:25 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:26.907188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-229a3dbf-f4c7-4b2e-9d55-e5bb48717fec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:26.908836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-229a3dbf-f4c7-4b2e-9d55-e5bb48717fec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:26.915733 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-229a3dbf-f4c7-4b2e-9d55-e5bb48717fec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:26.916189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-229a3dbf-f4c7-4b2e-9d55-e5bb48717fec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:26.916954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-229a3dbf-f4c7-4b2e-9d55-e5bb48717fec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:26.917389 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-229a3dbf-f4c7-4b2e-9d55-e5bb48717fec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:27.005810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-229a3dbf-f4c7-4b2e-9d55-e5bb48717fec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.102537 Jan 25 03:47:27.006455 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 729/1387] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:26 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:28.017771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-032a8179-3dcf-412c-94a7-2f78e5293dcd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:28.018783 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-032a8179-3dcf-412c-94a7-2f78e5293dcd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:28.025788 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032a8179-3dcf-412c-94a7-2f78e5293dcd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:28.026246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032a8179-3dcf-412c-94a7-2f78e5293dcd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:28.027029 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032a8179-3dcf-412c-94a7-2f78e5293dcd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:28.027502 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-032a8179-3dcf-412c-94a7-2f78e5293dcd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:28.120176 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-032a8179-3dcf-412c-94a7-2f78e5293dcd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.106421 Jan 25 03:47:28.120812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 659/1388] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:28 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:47:29.132624 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-710cedfb-6214-4b79-99c1-af154ed5e90e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:29.133636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-710cedfb-6214-4b79-99c1-af154ed5e90e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:29.141954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-710cedfb-6214-4b79-99c1-af154ed5e90e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:29.142412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-710cedfb-6214-4b79-99c1-af154ed5e90e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:29.143237 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-710cedfb-6214-4b79-99c1-af154ed5e90e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:29.144332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-710cedfb-6214-4b79-99c1-af154ed5e90e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:29.235078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-710cedfb-6214-4b79-99c1-af154ed5e90e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.106386 Jan 25 03:47:29.235913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 730/1389] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:29 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:47:30.247523 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-62a0f3eb-ca09-471c-b413-4418528bc564 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:30.248551 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-62a0f3eb-ca09-471c-b413-4418528bc564 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:30.256069 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62a0f3eb-ca09-471c-b413-4418528bc564 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:30.256526 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62a0f3eb-ca09-471c-b413-4418528bc564 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:30.257309 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62a0f3eb-ca09-471c-b413-4418528bc564 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:30.257754 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-62a0f3eb-ca09-471c-b413-4418528bc564 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:30.346211 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-62a0f3eb-ca09-471c-b413-4418528bc564 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.102659 Jan 25 03:47:30.346845 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 660/1390] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:30 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:31.358456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1a9624cf-3ddc-467f-b7cf-1f737b8c1516 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:31.359663 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1a9624cf-3ddc-467f-b7cf-1f737b8c1516 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:31.366904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a9624cf-3ddc-467f-b7cf-1f737b8c1516 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:31.367361 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a9624cf-3ddc-467f-b7cf-1f737b8c1516 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:31.368145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a9624cf-3ddc-467f-b7cf-1f737b8c1516 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:31.368584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a9624cf-3ddc-467f-b7cf-1f737b8c1516 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:31.453922 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1a9624cf-3ddc-467f-b7cf-1f737b8c1516 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.099302 Jan 25 03:47:31.454762 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 731/1391] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:31 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:32.466086 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-52d4a8af-6d7c-4b6d-a4fd-98dc016082d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:32.467113 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-52d4a8af-6d7c-4b6d-a4fd-98dc016082d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:32.474138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d4a8af-6d7c-4b6d-a4fd-98dc016082d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:32.474595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d4a8af-6d7c-4b6d-a4fd-98dc016082d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:32.475444 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d4a8af-6d7c-4b6d-a4fd-98dc016082d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:32.475889 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-52d4a8af-6d7c-4b6d-a4fd-98dc016082d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:32.558705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-52d4a8af-6d7c-4b6d-a4fd-98dc016082d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.096642 Jan 25 03:47:32.559385 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 661/1392] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:32 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:33.571374 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3ac229d3-6fc7-4c7f-a300-9006b4ef4fc5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:33.572366 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3ac229d3-6fc7-4c7f-a300-9006b4ef4fc5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:33.579780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3ac229d3-6fc7-4c7f-a300-9006b4ef4fc5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:33.580236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3ac229d3-6fc7-4c7f-a300-9006b4ef4fc5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:33.581007 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3ac229d3-6fc7-4c7f-a300-9006b4ef4fc5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:33.581442 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3ac229d3-6fc7-4c7f-a300-9006b4ef4fc5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:33.683711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3ac229d3-6fc7-4c7f-a300-9006b4ef4fc5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.116032 Jan 25 03:47:33.687509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 732/1393] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:33 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:34.695361 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c83d102f-4a69-4998-be6f-70c44346b9e3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:34.696351 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c83d102f-4a69-4998-be6f-70c44346b9e3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:34.703158 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83d102f-4a69-4998-be6f-70c44346b9e3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:34.703605 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83d102f-4a69-4998-be6f-70c44346b9e3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:34.704880 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83d102f-4a69-4998-be6f-70c44346b9e3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:34.705314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c83d102f-4a69-4998-be6f-70c44346b9e3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:34.791196 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c83d102f-4a69-4998-be6f-70c44346b9e3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28202 microversion: 2.1 time: 0.099775 Jan 25 03:47:34.792080 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 662/1394] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:34 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:35.803598 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-999a6138-4a32-4a7c-b5df-7aeca4a67573 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:35.804528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-999a6138-4a32-4a7c-b5df-7aeca4a67573 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:35.811604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999a6138-4a32-4a7c-b5df-7aeca4a67573 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:35.812058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999a6138-4a32-4a7c-b5df-7aeca4a67573 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:35.812834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999a6138-4a32-4a7c-b5df-7aeca4a67573 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:35.813271 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-999a6138-4a32-4a7c-b5df-7aeca4a67573 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:35.919912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-999a6138-4a32-4a7c-b5df-7aeca4a67573 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28493 microversion: 2.1 time: 0.120222 Jan 25 03:47:35.920812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 733/1395] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:35 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28493 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:36.932377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7d7b6214-297a-430e-8f05-fe4dd9563501 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:36.933389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7d7b6214-297a-430e-8f05-fe4dd9563501 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:36.940877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d7b6214-297a-430e-8f05-fe4dd9563501 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:36.941324 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d7b6214-297a-430e-8f05-fe4dd9563501 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:36.942109 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d7b6214-297a-430e-8f05-fe4dd9563501 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:36.942542 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d7b6214-297a-430e-8f05-fe4dd9563501 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:37.043564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7d7b6214-297a-430e-8f05-fe4dd9563501 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.115239 Jan 25 03:47:37.047097 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 663/1396] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:36 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:38.056440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d0af741a-9434-40b5-8b78-1c0fd92d6efe tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:38.057466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d0af741a-9434-40b5-8b78-1c0fd92d6efe tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:38.064538 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0af741a-9434-40b5-8b78-1c0fd92d6efe tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:38.068217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0af741a-9434-40b5-8b78-1c0fd92d6efe tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:38.068217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0af741a-9434-40b5-8b78-1c0fd92d6efe tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:38.068217 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d0af741a-9434-40b5-8b78-1c0fd92d6efe tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:38.153809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d0af741a-9434-40b5-8b78-1c0fd92d6efe tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.101732 Jan 25 03:47:38.154448 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 734/1397] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:38 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:39.166149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-6c41543f-42d1-4be3-b828-e83949d61203 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:39.167190 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-6c41543f-42d1-4be3-b828-e83949d61203 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:39.174895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c41543f-42d1-4be3-b828-e83949d61203 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:39.175364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c41543f-42d1-4be3-b828-e83949d61203 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:39.176135 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c41543f-42d1-4be3-b828-e83949d61203 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:39.176568 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-6c41543f-42d1-4be3-b828-e83949d61203 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:39.261731 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-6c41543f-42d1-4be3-b828-e83949d61203 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.099468 Jan 25 03:47:39.262402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 664/1398] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:39 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:40.273813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c1572a4c-d6f0-4531-884d-9c985bef0377 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:40.274802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c1572a4c-d6f0-4531-884d-9c985bef0377 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:40.281594 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1572a4c-d6f0-4531-884d-9c985bef0377 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:40.282558 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1572a4c-d6f0-4531-884d-9c985bef0377 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:40.283352 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1572a4c-d6f0-4531-884d-9c985bef0377 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:40.283785 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c1572a4c-d6f0-4531-884d-9c985bef0377 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:40.379769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c1572a4c-d6f0-4531-884d-9c985bef0377 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.109832 Jan 25 03:47:40.380434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 735/1399] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:40 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:41.392726 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-5ad8a220-cb19-44d4-8f73-23e2581392a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:41.393756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-5ad8a220-cb19-44d4-8f73-23e2581392a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:41.400603 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ad8a220-cb19-44d4-8f73-23e2581392a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:41.406215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ad8a220-cb19-44d4-8f73-23e2581392a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:41.406215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ad8a220-cb19-44d4-8f73-23e2581392a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:41.406215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-5ad8a220-cb19-44d4-8f73-23e2581392a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:41.487355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-5ad8a220-cb19-44d4-8f73-23e2581392a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.099306 Jan 25 03:47:41.488002 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 665/1400] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:41 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:42.499310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1be4af6d-eadf-49a7-a561-d5232581e5b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:42.500317 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1be4af6d-eadf-49a7-a561-d5232581e5b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:42.507725 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1be4af6d-eadf-49a7-a561-d5232581e5b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:42.508190 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1be4af6d-eadf-49a7-a561-d5232581e5b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:42.508974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1be4af6d-eadf-49a7-a561-d5232581e5b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:42.509416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1be4af6d-eadf-49a7-a561-d5232581e5b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:42.609104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1be4af6d-eadf-49a7-a561-d5232581e5b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.113631 Jan 25 03:47:42.609653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 736/1401] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:42 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:43.621805 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b3292f00-e08c-4641-be91-9c80bc4724c8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:43.622799 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b3292f00-e08c-4641-be91-9c80bc4724c8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:43.630292 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3292f00-e08c-4641-be91-9c80bc4724c8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:43.630736 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3292f00-e08c-4641-be91-9c80bc4724c8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:43.631530 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3292f00-e08c-4641-be91-9c80bc4724c8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:43.631961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b3292f00-e08c-4641-be91-9c80bc4724c8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:43.714471 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b3292f00-e08c-4641-be91-9c80bc4724c8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.096570 Jan 25 03:47:43.715134 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 666/1402] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:43 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:44.726834 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ad741929-761e-4aaa-a042-57e986fa4b5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:44.727865 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ad741929-761e-4aaa-a042-57e986fa4b5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:44.734785 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad741929-761e-4aaa-a042-57e986fa4b5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:44.735976 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad741929-761e-4aaa-a042-57e986fa4b5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:44.736769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad741929-761e-4aaa-a042-57e986fa4b5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:44.737211 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ad741929-761e-4aaa-a042-57e986fa4b5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:44.823528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ad741929-761e-4aaa-a042-57e986fa4b5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.100635 Jan 25 03:47:44.824437 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 737/1403] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:44 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:45.835262 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-605fd6f9-2aa7-4616-93a7-235d860997d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:45.836242 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-605fd6f9-2aa7-4616-93a7-235d860997d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:45.842997 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-605fd6f9-2aa7-4616-93a7-235d860997d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:45.843457 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-605fd6f9-2aa7-4616-93a7-235d860997d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:45.844220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-605fd6f9-2aa7-4616-93a7-235d860997d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:45.844649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-605fd6f9-2aa7-4616-93a7-235d860997d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:45.927169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-605fd6f9-2aa7-4616-93a7-235d860997d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.095772 Jan 25 03:47:45.927793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 667/1404] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:45 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:47:46.939805 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-78e5fc19-33ff-443a-b79d-2abf3bb60d9f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:46.940847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-78e5fc19-33ff-443a-b79d-2abf3bb60d9f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:46.947706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78e5fc19-33ff-443a-b79d-2abf3bb60d9f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:46.948194 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78e5fc19-33ff-443a-b79d-2abf3bb60d9f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:46.948995 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78e5fc19-33ff-443a-b79d-2abf3bb60d9f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:46.949433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78e5fc19-33ff-443a-b79d-2abf3bb60d9f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:47.040234 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-78e5fc19-33ff-443a-b79d-2abf3bb60d9f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.104688 Jan 25 03:47:47.040909 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 738/1405] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:46 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:48.053868 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-01ed6975-1089-46d9-a3eb-e75f6a39a23f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:48.054948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-01ed6975-1089-46d9-a3eb-e75f6a39a23f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:48.062011 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-01ed6975-1089-46d9-a3eb-e75f6a39a23f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:48.062453 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-01ed6975-1089-46d9-a3eb-e75f6a39a23f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:48.063254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-01ed6975-1089-46d9-a3eb-e75f6a39a23f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:48.063691 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-01ed6975-1089-46d9-a3eb-e75f6a39a23f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:48.162506 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-01ed6975-1089-46d9-a3eb-e75f6a39a23f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.113603 Jan 25 03:47:48.163175 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 668/1406] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:48 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:49.174390 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1a675c75-dbfe-4107-8d01-2850198a49c3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:49.175418 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1a675c75-dbfe-4107-8d01-2850198a49c3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:49.182537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a675c75-dbfe-4107-8d01-2850198a49c3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:49.182996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a675c75-dbfe-4107-8d01-2850198a49c3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:49.183871 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a675c75-dbfe-4107-8d01-2850198a49c3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:49.184314 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1a675c75-dbfe-4107-8d01-2850198a49c3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:49.268221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1a675c75-dbfe-4107-8d01-2850198a49c3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.097912 Jan 25 03:47:49.268852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 739/1407] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:49 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:50.280184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-096e5e4b-e039-40eb-b7eb-e7db9d68b8cf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:50.281169 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-096e5e4b-e039-40eb-b7eb-e7db9d68b8cf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:50.288633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-096e5e4b-e039-40eb-b7eb-e7db9d68b8cf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:50.289077 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-096e5e4b-e039-40eb-b7eb-e7db9d68b8cf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:50.289838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-096e5e4b-e039-40eb-b7eb-e7db9d68b8cf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:50.290263 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-096e5e4b-e039-40eb-b7eb-e7db9d68b8cf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:50.386575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-096e5e4b-e039-40eb-b7eb-e7db9d68b8cf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.110195 Jan 25 03:47:50.387561 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 669/1408] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:50 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:51.398301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-55694445-abcb-4d24-8bc3-d16ae5c73c5d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:51.399336 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-55694445-abcb-4d24-8bc3-d16ae5c73c5d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:51.406493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55694445-abcb-4d24-8bc3-d16ae5c73c5d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:51.406939 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55694445-abcb-4d24-8bc3-d16ae5c73c5d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:51.408297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55694445-abcb-4d24-8bc3-d16ae5c73c5d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:51.408779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-55694445-abcb-4d24-8bc3-d16ae5c73c5d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:51.565818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-55694445-abcb-4d24-8bc3-d16ae5c73c5d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.171252 Jan 25 03:47:51.566497 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 740/1409] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:51 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:52.577743 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ec980bac-effc-4192-ba43-9cd1a913bb60 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:52.578729 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ec980bac-effc-4192-ba43-9cd1a913bb60 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:52.585773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec980bac-effc-4192-ba43-9cd1a913bb60 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:52.586215 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec980bac-effc-4192-ba43-9cd1a913bb60 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:52.586976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec980bac-effc-4192-ba43-9cd1a913bb60 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:52.587431 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ec980bac-effc-4192-ba43-9cd1a913bb60 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:52.679075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ec980bac-effc-4192-ba43-9cd1a913bb60 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.105167 Jan 25 03:47:52.679736 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 670/1410] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:52 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:53.692297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e26d3aa0-046f-4704-8cc5-0740b8f0b436 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:53.693301 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e26d3aa0-046f-4704-8cc5-0740b8f0b436 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:53.700116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e26d3aa0-046f-4704-8cc5-0740b8f0b436 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:53.700573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e26d3aa0-046f-4704-8cc5-0740b8f0b436 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:53.701344 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e26d3aa0-046f-4704-8cc5-0740b8f0b436 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:53.701778 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e26d3aa0-046f-4704-8cc5-0740b8f0b436 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:53.800654 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e26d3aa0-046f-4704-8cc5-0740b8f0b436 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.113001 Jan 25 03:47:53.801302 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 741/1411] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:53 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:54.813119 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-174e1298-780d-4c58-b817-34fa8196a606 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:54.815031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-174e1298-780d-4c58-b817-34fa8196a606 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:54.821904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-174e1298-780d-4c58-b817-34fa8196a606 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:54.822350 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-174e1298-780d-4c58-b817-34fa8196a606 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:54.823149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-174e1298-780d-4c58-b817-34fa8196a606 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:54.823588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-174e1298-780d-4c58-b817-34fa8196a606 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:54.907693 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-174e1298-780d-4c58-b817-34fa8196a606 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.098502 Jan 25 03:47:54.908382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 671/1412] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:54 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:55.919861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7a391ee1-5100-4173-9601-f5dd6f46ed97 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:55.920897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7a391ee1-5100-4173-9601-f5dd6f46ed97 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:55.928390 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a391ee1-5100-4173-9601-f5dd6f46ed97 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:55.928850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a391ee1-5100-4173-9601-f5dd6f46ed97 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:55.929637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a391ee1-5100-4173-9601-f5dd6f46ed97 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:55.930346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7a391ee1-5100-4173-9601-f5dd6f46ed97 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:56.021709 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7a391ee1-5100-4173-9601-f5dd6f46ed97 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.105660 Jan 25 03:47:56.022487 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 742/1413] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:55 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:57.034804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b26978b8-58dd-4116-baf8-11d1e89d0119 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:57.035838 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b26978b8-58dd-4116-baf8-11d1e89d0119 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:57.042908 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b26978b8-58dd-4116-baf8-11d1e89d0119 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:57.043380 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b26978b8-58dd-4116-baf8-11d1e89d0119 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:57.044156 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b26978b8-58dd-4116-baf8-11d1e89d0119 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:57.044588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b26978b8-58dd-4116-baf8-11d1e89d0119 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:57.132411 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b26978b8-58dd-4116-baf8-11d1e89d0119 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.102437 Jan 25 03:47:57.133093 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 672/1414] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:57 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:58.145397 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c166f484-425d-40a9-9379-feb1f5b76775 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:58.146403 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c166f484-425d-40a9-9379-feb1f5b76775 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:58.153262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c166f484-425d-40a9-9379-feb1f5b76775 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:58.153721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c166f484-425d-40a9-9379-feb1f5b76775 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:58.154502 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c166f484-425d-40a9-9379-feb1f5b76775 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:58.154946 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c166f484-425d-40a9-9379-feb1f5b76775 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:58.248393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c166f484-425d-40a9-9379-feb1f5b76775 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.107740 Jan 25 03:47:58.249047 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 743/1415] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:58 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:47:59.260372 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e1a77fc6-46a6-4ffa-8f79-d6361c5104ba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:47:59.261390 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e1a77fc6-46a6-4ffa-8f79-d6361c5104ba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:47:59.268204 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e1a77fc6-46a6-4ffa-8f79-d6361c5104ba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:59.268651 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e1a77fc6-46a6-4ffa-8f79-d6361c5104ba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:59.269419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e1a77fc6-46a6-4ffa-8f79-d6361c5104ba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:47:59.269850 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e1a77fc6-46a6-4ffa-8f79-d6361c5104ba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:47:59.357602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e1a77fc6-46a6-4ffa-8f79-d6361c5104ba tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.101138 Jan 25 03:47:59.358249 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 673/1416] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:47:59 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:00.370227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-85b33998-c599-43ec-8f74-dddb524f2f74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:00.371256 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-85b33998-c599-43ec-8f74-dddb524f2f74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:00.378749 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85b33998-c599-43ec-8f74-dddb524f2f74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:00.383889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85b33998-c599-43ec-8f74-dddb524f2f74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:00.383889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85b33998-c599-43ec-8f74-dddb524f2f74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:00.383889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-85b33998-c599-43ec-8f74-dddb524f2f74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:00.474679 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-85b33998-c599-43ec-8f74-dddb524f2f74 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.108362 Jan 25 03:48:00.476114 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 744/1417] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:00 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:01.486825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d7d1b765-187c-4564-8d6e-70233b6c9351 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:01.488050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d7d1b765-187c-4564-8d6e-70233b6c9351 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:01.495161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7d1b765-187c-4564-8d6e-70233b6c9351 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:01.495612 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7d1b765-187c-4564-8d6e-70233b6c9351 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:01.496426 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7d1b765-187c-4564-8d6e-70233b6c9351 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:01.496854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d7d1b765-187c-4564-8d6e-70233b6c9351 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:01.585047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d7d1b765-187c-4564-8d6e-70233b6c9351 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.102643 Jan 25 03:48:01.585948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 674/1418] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:01 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:02.599821 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8cc5b856-bfa9-427b-b60f-81e09407abe5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:02.600829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8cc5b856-bfa9-427b-b60f-81e09407abe5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:02.607812 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cc5b856-bfa9-427b-b60f-81e09407abe5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:02.608216 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cc5b856-bfa9-427b-b60f-81e09407abe5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:02.608994 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cc5b856-bfa9-427b-b60f-81e09407abe5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:02.609435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8cc5b856-bfa9-427b-b60f-81e09407abe5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:02.693266 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8cc5b856-bfa9-427b-b60f-81e09407abe5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.097548 Jan 25 03:48:02.694061 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 745/1419] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:02 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:03.706432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-065d3854-cc90-42de-beef-efbc44dbaab0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:03.707493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-065d3854-cc90-42de-beef-efbc44dbaab0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:03.714359 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-065d3854-cc90-42de-beef-efbc44dbaab0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:03.714814 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-065d3854-cc90-42de-beef-efbc44dbaab0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:03.715633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-065d3854-cc90-42de-beef-efbc44dbaab0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:03.716076 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-065d3854-cc90-42de-beef-efbc44dbaab0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:03.801575 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-065d3854-cc90-42de-beef-efbc44dbaab0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.099770 Jan 25 03:48:03.802486 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 675/1420] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:03 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:04.814509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-35c11c05-e25a-41e8-ac6d-dd885946637f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:04.815678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-35c11c05-e25a-41e8-ac6d-dd885946637f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:04.822584 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35c11c05-e25a-41e8-ac6d-dd885946637f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:04.823043 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35c11c05-e25a-41e8-ac6d-dd885946637f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:04.823845 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35c11c05-e25a-41e8-ac6d-dd885946637f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:04.824291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-35c11c05-e25a-41e8-ac6d-dd885946637f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:04.921010 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-35c11c05-e25a-41e8-ac6d-dd885946637f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.110893 Jan 25 03:48:04.921948 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 746/1421] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:04 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:05.934042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-cde3d93f-bb2e-425f-9265-2106a85fc97a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:05.935032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-cde3d93f-bb2e-425f-9265-2106a85fc97a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:05.942841 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cde3d93f-bb2e-425f-9265-2106a85fc97a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:05.943327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cde3d93f-bb2e-425f-9265-2106a85fc97a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:05.944103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cde3d93f-bb2e-425f-9265-2106a85fc97a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:05.944540 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-cde3d93f-bb2e-425f-9265-2106a85fc97a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:06.037156 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-cde3d93f-bb2e-425f-9265-2106a85fc97a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.107245 Jan 25 03:48:06.037808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 676/1422] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:05 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:07.048907 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-31fc7bba-d7f4-474f-b05c-f5e7a717bd78 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:07.049794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-31fc7bba-d7f4-474f-b05c-f5e7a717bd78 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:07.056904 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31fc7bba-d7f4-474f-b05c-f5e7a717bd78 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:07.057360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31fc7bba-d7f4-474f-b05c-f5e7a717bd78 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:07.058169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31fc7bba-d7f4-474f-b05c-f5e7a717bd78 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:07.058613 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-31fc7bba-d7f4-474f-b05c-f5e7a717bd78 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:07.147559 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-31fc7bba-d7f4-474f-b05c-f5e7a717bd78 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.102675 Jan 25 03:48:07.148454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 747/1423] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:07 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:08.160348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9018bfc1-36d1-4605-94d3-455f541f3365 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:08.161343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9018bfc1-36d1-4605-94d3-455f541f3365 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:08.168170 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9018bfc1-36d1-4605-94d3-455f541f3365 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:08.168618 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9018bfc1-36d1-4605-94d3-455f541f3365 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:08.169386 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9018bfc1-36d1-4605-94d3-455f541f3365 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:08.169817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9018bfc1-36d1-4605-94d3-455f541f3365 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:08.251042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9018bfc1-36d1-4605-94d3-455f541f3365 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 28661 microversion: 2.1 time: 0.095413 Jan 25 03:48:08.251653 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 677/1424] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:08 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 28661 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:09.262957 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9e4193cf-9e59-44d5-9ad1-58f30c593bbc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:09.263999 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9e4193cf-9e59-44d5-9ad1-58f30c593bbc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:09.270984 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4193cf-9e59-44d5-9ad1-58f30c593bbc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:09.271469 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4193cf-9e59-44d5-9ad1-58f30c593bbc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:09.272251 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4193cf-9e59-44d5-9ad1-58f30c593bbc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:09.272694 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9e4193cf-9e59-44d5-9ad1-58f30c593bbc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:09.366711 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9e4193cf-9e59-44d5-9ad1-58f30c593bbc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 30538 microversion: 2.1 time: 0.107657 Jan 25 03:48:09.369260 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 748/1425] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:09 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 30538 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:10.378858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-66901aad-51d2-48df-95df-541c8befc3bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:10.386423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-66901aad-51d2-48df-95df-541c8befc3bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:10.386690 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-66901aad-51d2-48df-95df-541c8befc3bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:10.387167 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-66901aad-51d2-48df-95df-541c8befc3bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:10.387934 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-66901aad-51d2-48df-95df-541c8befc3bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:10.388365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-66901aad-51d2-48df-95df-541c8befc3bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:10.490655 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-66901aad-51d2-48df-95df-541c8befc3bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 32516 microversion: 2.1 time: 0.115677 Jan 25 03:48:10.491520 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 678/1426] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:10 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 32516 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:11.502143 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d462579a-ff77-4e66-9a3b-83ed47e0f4b8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:11.503115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d462579a-ff77-4e66-9a3b-83ed47e0f4b8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:11.510062 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d462579a-ff77-4e66-9a3b-83ed47e0f4b8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:11.510519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d462579a-ff77-4e66-9a3b-83ed47e0f4b8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:11.511332 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d462579a-ff77-4e66-9a3b-83ed47e0f4b8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:11.511775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d462579a-ff77-4e66-9a3b-83ed47e0f4b8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:11.636544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d462579a-ff77-4e66-9a3b-83ed47e0f4b8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 33616 microversion: 2.1 time: 0.138469 Jan 25 03:48:11.637474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 749/1427] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:11 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 33616 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:12.649141 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a97f8909-98ff-404d-872e-b98ca156ab82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:12.650142 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a97f8909-98ff-404d-872e-b98ca156ab82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:12.657048 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a97f8909-98ff-404d-872e-b98ca156ab82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:12.657555 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a97f8909-98ff-404d-872e-b98ca156ab82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:12.658375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a97f8909-98ff-404d-872e-b98ca156ab82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:12.658814 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a97f8909-98ff-404d-872e-b98ca156ab82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:12.749290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a97f8909-98ff-404d-872e-b98ca156ab82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 34922 microversion: 2.1 time: 0.104131 Jan 25 03:48:12.749942 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 679/1428] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:12 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 34922 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:13.762136 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-073e49a2-2204-49e4-aaba-565e8675f20b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:13.763175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-073e49a2-2204-49e4-aaba-565e8675f20b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:13.770024 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-073e49a2-2204-49e4-aaba-565e8675f20b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:13.770477 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-073e49a2-2204-49e4-aaba-565e8675f20b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:13.771292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-073e49a2-2204-49e4-aaba-565e8675f20b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:13.771731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-073e49a2-2204-49e4-aaba-565e8675f20b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:13.875126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-073e49a2-2204-49e4-aaba-565e8675f20b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 36237 microversion: 2.1 time: 0.116870 Jan 25 03:48:13.875782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 750/1429] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:13 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 36237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:14.887731 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3fdadb02-3b5d-44be-8d81-14aec92ca410 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:14.888739 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3fdadb02-3b5d-44be-8d81-14aec92ca410 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:14.895744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3fdadb02-3b5d-44be-8d81-14aec92ca410 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:14.896197 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3fdadb02-3b5d-44be-8d81-14aec92ca410 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:14.896976 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3fdadb02-3b5d-44be-8d81-14aec92ca410 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:14.897415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3fdadb02-3b5d-44be-8d81-14aec92ca410 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:14.987064 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3fdadb02-3b5d-44be-8d81-14aec92ca410 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 37889 microversion: 2.1 time: 0.103358 Jan 25 03:48:14.987735 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 680/1430] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:14 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 37889 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:15.999501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0761fb90-4c0b-4991-86fa-4ef6e65fc24f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:16.000488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0761fb90-4c0b-4991-86fa-4ef6e65fc24f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:16.008645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0761fb90-4c0b-4991-86fa-4ef6e65fc24f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:16.009099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0761fb90-4c0b-4991-86fa-4ef6e65fc24f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:16.009869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0761fb90-4c0b-4991-86fa-4ef6e65fc24f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:16.010305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0761fb90-4c0b-4991-86fa-4ef6e65fc24f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:16.102970 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0761fb90-4c0b-4991-86fa-4ef6e65fc24f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 38192 microversion: 2.1 time: 0.107536 Jan 25 03:48:16.103868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 751/1431] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:15 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 38192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:17.115288 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ff6a8629-d21d-404f-9c18-54af34188368 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:17.116276 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-ff6a8629-d21d-404f-9c18-54af34188368 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:17.123041 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ff6a8629-d21d-404f-9c18-54af34188368 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:17.123517 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ff6a8629-d21d-404f-9c18-54af34188368 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:17.124282 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ff6a8629-d21d-404f-9c18-54af34188368 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:17.124711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-ff6a8629-d21d-404f-9c18-54af34188368 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:17.208200 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ff6a8629-d21d-404f-9c18-54af34188368 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 38192 microversion: 2.1 time: 0.096902 Jan 25 03:48:17.208837 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 681/1432] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:17 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 38192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:18.220583 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5ffee9c0-6590-4e58-9b1a-79b847c0ef58 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:18.221845 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5ffee9c0-6590-4e58-9b1a-79b847c0ef58 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:18.228720 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ffee9c0-6590-4e58-9b1a-79b847c0ef58 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:18.229183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ffee9c0-6590-4e58-9b1a-79b847c0ef58 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:18.229962 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ffee9c0-6590-4e58-9b1a-79b847c0ef58 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:18.230406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5ffee9c0-6590-4e58-9b1a-79b847c0ef58 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:18.325668 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5ffee9c0-6590-4e58-9b1a-79b847c0ef58 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 38192 microversion: 2.1 time: 0.109035 Jan 25 03:48:18.326457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 752/1433] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:18 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 38192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:19.337936 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e639b160-679a-49cc-a1f3-84a0e40e9109 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:19.338918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e639b160-679a-49cc-a1f3-84a0e40e9109 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:19.345705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e639b160-679a-49cc-a1f3-84a0e40e9109 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:19.346830 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e639b160-679a-49cc-a1f3-84a0e40e9109 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:19.347616 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e639b160-679a-49cc-a1f3-84a0e40e9109 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:19.348050 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e639b160-679a-49cc-a1f3-84a0e40e9109 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:19.439101 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e639b160-679a-49cc-a1f3-84a0e40e9109 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 38196 microversion: 2.1 time: 0.104943 Jan 25 03:48:19.439655 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 682/1434] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:19 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 38196 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:20.451673 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0a997fec-c9de-4f66-9eec-27beecd9d28b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:20.452664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0a997fec-c9de-4f66-9eec-27beecd9d28b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:20.461355 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a997fec-c9de-4f66-9eec-27beecd9d28b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:20.462116 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a997fec-c9de-4f66-9eec-27beecd9d28b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:20.462955 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a997fec-c9de-4f66-9eec-27beecd9d28b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:20.463779 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0a997fec-c9de-4f66-9eec-27beecd9d28b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:20.560440 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0a997fec-c9de-4f66-9eec-27beecd9d28b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 200 len: 38321 microversion: 2.1 time: 0.112820 Jan 25 03:48:20.561097 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 753/1435] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:20 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 38321 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:48:20.571668 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-68939352-d80d-40aa-9246-b5de59cf9b79 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:20.572245 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-68939352-d80d-40aa-9246-b5de59cf9b79 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:20.579040 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68939352-d80d-40aa-9246-b5de59cf9b79 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:20.579525 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68939352-d80d-40aa-9246-b5de59cf9b79 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:20.580481 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68939352-d80d-40aa-9246-b5de59cf9b79 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:20.581134 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-68939352-d80d-40aa-9246-b5de59cf9b79 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:20.606756 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-68939352-d80d-40aa-9246-b5de59cf9b79 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/ips" status: 200 len: 146 microversion: 2.1 time: 0.038970 Jan 25 03:48:20.607298 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 683/1436] 10.222.0.115 () {58 vars in 1252 bytes} [Tue Jan 25 03:48:20 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:48:24.206036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f2a7d3ec-1f89-476a-8cb6-7544020f0d1c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a94db642-b724-4083-8666-673f0cc40734"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:24.207315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f2a7d3ec-1f89-476a-8cb6-7544020f0d1c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:24.214201 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2a7d3ec-1f89-476a-8cb6-7544020f0d1c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:24.214657 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2a7d3ec-1f89-476a-8cb6-7544020f0d1c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:24.215465 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2a7d3ec-1f89-476a-8cb6-7544020f0d1c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:24.215907 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f2a7d3ec-1f89-476a-8cb6-7544020f0d1c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:24.822881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f2a7d3ec-1f89-476a-8cb6-7544020f0d1c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620770 Jan 25 03:48:24.823473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 754/1437] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:48:24 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:48:33.336135 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-30337b2b-ea76-4524-9bf1-a8e7973c232b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:33.342641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-30337b2b-ea76-4524-9bf1-a8e7973c232b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:33.343188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-30337b2b-ea76-4524-9bf1-a8e7973c232b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:33.402332 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-30337b2b-ea76-4524-9bf1-a8e7973c232b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Going to try to stop instance {{(pid=123363) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 25 03:48:33.552400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-30337b2b-ea76-4524-9bf1-a8e7973c232b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 202 len: 0 microversion: 2.1 time: 0.220051 Jan 25 03:48:33.553004 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 684/1438] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:33 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:48:33.562453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:33.563212 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:33.569462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:33.569918 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:33.570693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:33.571152 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:33.712106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:33.720085 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-15c2f91a-7ea4-4c28-b6e8-69dcf6b19dce tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.162444 Jan 25 03:48:33.720667 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 755/1439] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:33 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:34.739076 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:34.739782 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:34.745854 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:34.746306 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:34.747102 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:34.747545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:34.878747 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:34.886574 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e9c79682-2b11-4a6e-a45d-ec80882fcaca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.152581 Jan 25 03:48:34.887161 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 685/1440] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:34 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:35.903925 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:35.904573 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:35.911835 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:35.912294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:35.913077 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:35.913519 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:36.044054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:36.052306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-eefb934a-0b63-4c4b-91e1-10e1a89f1e68 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.152033 Jan 25 03:48:36.052890 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 756/1441] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:35 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:37.070125 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:37.070680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:37.076905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:37.077346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:37.078107 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:37.078532 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:37.208074 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:37.216032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fa757bf3-c4f8-4520-aeaf-70d4dfe886f2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.150120 Jan 25 03:48:37.225895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 686/1442] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:37 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:38.232685 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:38.233299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:38.239846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:38.240305 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:38.241093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:38.241533 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:38.372272 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:38.381070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-78018494-020c-4101-9e3b-73ed73750223 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.151998 Jan 25 03:48:38.381641 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 757/1443] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:38 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:39.398420 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:39.398969 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:39.405447 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:39.405904 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:39.406680 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:39.407142 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:39.540454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:39.548195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9e5efc4a-d3b4-4a73-a13c-c81cd5e77e5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.153613 Jan 25 03:48:39.548769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 687/1444] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:39 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:40.564878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:40.566066 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:40.572643 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:40.573101 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:40.573884 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:40.574329 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:40.699514 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:40.707295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3cfddda7-2aa3-48e0-9d1f-29e105469c09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.146073 Jan 25 03:48:40.707864 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 758/1445] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:40 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:41.725586 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:41.725586 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:41.731930 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:41.732386 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:41.733199 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:41.733637 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:41.864627 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:41.872382 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-46f55c08-e243-4f43-bc1d-e2cb2db2bae3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.152019 Jan 25 03:48:41.872948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 688/1446] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:41 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:42.890243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:42.890861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:42.897836 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:42.898294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:42.899103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:42.899561 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:43.056399 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:43.064388 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-535152ec-c49c-4948-98dd-47deedf0a0b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1728 microversion: 2.1 time: 0.177799 Jan 25 03:48:43.064969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 759/1447] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:42 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:44.081958 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:44.082570 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:44.092717 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:44.093506 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:44.094727 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:44.095355 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:44.230433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:44.238538 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3d99d23e-9d68-411a-82ec-0e56ac1df297 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1705 microversion: 2.1 time: 0.160726 Jan 25 03:48:44.239121 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 689/1448] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:44 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1705 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:44.254730 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9c2ba22c-c156-4336-8cf2-993e60b379a3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:44.261005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9c2ba22c-c156-4336-8cf2-993e60b379a3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:44.261459 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9c2ba22c-c156-4336-8cf2-993e60b379a3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:44.321436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9c2ba22c-c156-4336-8cf2-993e60b379a3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Going to try to start instance {{(pid=123362) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 25 03:48:44.489486 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9c2ba22c-c156-4336-8cf2-993e60b379a3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 202 len: 0 microversion: 2.1 time: 0.238467 Jan 25 03:48:44.490093 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 760/1449] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:48:44 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:48:44.498008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:44.498622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:44.504996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:44.505459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:44.506243 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:44.506682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:44.638216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:44.646419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7d70d281-847b-4e1d-a716-62192460b16c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1714 microversion: 2.1 time: 0.152064 Jan 25 03:48:44.646996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 690/1450] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:44 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:45.664873 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:45.665809 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:45.671897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:45.672355 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:45.673140 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:45.673586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:45.808027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:45.815961 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8c9e0fcc-efd8-4505-bb9f-f0cbdb68be5b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1714 microversion: 2.1 time: 0.155626 Jan 25 03:48:45.816537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 761/1451] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:45 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:46.833875 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:46.834594 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:46.841133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:46.841588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:46.842378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:46.842820 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:46.971273 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:46.979126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3a787704-13d6-4c04-bd19-28dbf3b6f4c9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1718 microversion: 2.1 time: 0.149812 Jan 25 03:48:46.979686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 691/1452] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:46 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:47.642629 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:47.643205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:47.650494 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:47.650953 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:47.652798 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:47.653243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:47.680020 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:48:47.884136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-5a81aff5-d6dc-411e-9d13-a50cf21074e9 req-aa8c469a-042b-4db2-aadf-312346c6f5df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31fc95ec-6950-4d1c-8a8e-8cd379ddc451", "tag": "9fc9a725-79a8-415e-b949-ee950a70e69e"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:47.885678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:48:47.885678 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:48:47.892463 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-5a81aff5-d6dc-411e-9d13-a50cf21074e9 req-aa8c469a-042b-4db2-aadf-312346c6f5df service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:47.892943 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-5a81aff5-d6dc-411e-9d13-a50cf21074e9 req-aa8c469a-042b-4db2-aadf-312346c6f5df service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:47.904335 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-5a81aff5-d6dc-411e-9d13-a50cf21074e9 req-aa8c469a-042b-4db2-aadf-312346c6f5df service nova] Creating event network-changed:9fc9a725-79a8-415e-b949-ee950a70e69e for instance 31fc95ec-6950-4d1c-8a8e-8cd379ddc451 on hv-cinder-81901 Jan 25 03:48:47.909591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-5a81aff5-d6dc-411e-9d13-a50cf21074e9 req-aa8c469a-042b-4db2-aadf-312346c6f5df service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268298 Jan 25 03:48:47.910409 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 692/1453] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:48:47.911291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-97b59351-1726-4f36-a9c3-21e8d959362f tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "DELETE /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 204 len: 0 microversion: 2.1 time: 0.271068 Jan 25 03:48:47.916196 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 762/1454] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:48:47 2022] DELETE /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:48:47.922093 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:47.922797 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:47.930556 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:47.931017 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:47.931911 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:47.932356 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:48.161375 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:48.168865 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-89096fe1-c902-4e12-b323-c6f188ba5c58 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1579 microversion: 2.1 time: 0.251437 Jan 25 03:48:48.169557 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 693/1455] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:47 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1579 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:48:49.187914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:49.188623 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:49.195610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:49.196069 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:49.196854 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:49.197295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:49.335236 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:49.343144 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0d7324b2-d8b5-4f72-a1b3-338113f116f1 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1461 microversion: 2.1 time: 0.159161 Jan 25 03:48:49.343726 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 763/1456] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:49 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1461 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:50.310688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-4f28875f-28ff-4429-948e-4ea4ba800b40 req-0fbd04f2-28b2-4a41-bef1-b995527049e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31fc95ec-6950-4d1c-8a8e-8cd379ddc451", "name": "network-vif-deleted", "tag": "9fc9a725-79a8-415e-b949-ee950a70e69e"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:50.312320 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:48:50.312320 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:48:50.320600 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4f28875f-28ff-4429-948e-4ea4ba800b40 req-0fbd04f2-28b2-4a41-bef1-b995527049e0 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:50.321040 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-4f28875f-28ff-4429-948e-4ea4ba800b40 req-0fbd04f2-28b2-4a41-bef1-b995527049e0 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:50.331577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-4f28875f-28ff-4429-948e-4ea4ba800b40 req-0fbd04f2-28b2-4a41-bef1-b995527049e0 service nova] Creating event network-vif-deleted:9fc9a725-79a8-415e-b949-ee950a70e69e for instance 31fc95ec-6950-4d1c-8a8e-8cd379ddc451 on hv-cinder-81901 Jan 25 03:48:50.336505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-4f28875f-28ff-4429-948e-4ea4ba800b40 req-0fbd04f2-28b2-4a41-bef1-b995527049e0 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029424 Jan 25 03:48:50.337097 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 694/1457] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:48:50.361036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:50.362239 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:50.369183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:50.369892 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:50.370876 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:50.371353 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:50.431875 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:50.439308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-dbc078ef-2c24-45c1-b108-7a23be01fbe5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 200 len: 1395 microversion: 2.1 time: 0.082949 Jan 25 03:48:50.439912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 764/1458] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:50 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 1395 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:51.460470 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:51.461668 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 31fc95ec-6950-4d1c-8a8e-8cd379ddc451] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:51.468996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:51.472996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:51.472996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:51.472996 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:51.483765 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] HTTP exception thrown: Instance 31fc95ec-6950-4d1c-8a8e-8cd379ddc451 could not be found. Jan 25 03:48:51.484347 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Returning 404 to user: Instance 31fc95ec-6950-4d1c-8a8e-8cd379ddc451 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:48:51.485545 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0157149d-ba5e-4be8-8fb1-6f1a15f21354 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451" status: 404 len: 111 microversion: 2.1 time: 0.032771 Jan 25 03:48:51.485975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 695/1459] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:51 2022] GET /compute/v2.1/servers/31fc95ec-6950-4d1c-8a8e-8cd379ddc451 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:48:55.014246 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:48:55.014832 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:48:55.028185 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-83e029bd-a2bb-4f10-b3e5-32121f4eb582 req-1859b5cf-f310-452f-ae58-22f88572d66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6fc152-dc5c-493a-9933-95f0408e1caa", "tag": "b92e2cb6-c6e1-4723-843b-37dd1c830bbb"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:55.031686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:48:55.031686 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:48:55.037213 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-83e029bd-a2bb-4f10-b3e5-32121f4eb582 req-1859b5cf-f310-452f-ae58-22f88572d66a service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:55.037688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-83e029bd-a2bb-4f10-b3e5-32121f4eb582 req-1859b5cf-f310-452f-ae58-22f88572d66a service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:55.052321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-83e029bd-a2bb-4f10-b3e5-32121f4eb582 req-1859b5cf-f310-452f-ae58-22f88572d66a service nova] Creating event network-changed:b92e2cb6-c6e1-4723-843b-37dd1c830bbb for instance 7c6fc152-dc5c-493a-9933-95f0408e1caa on hv-cinder-81901 Jan 25 03:48:55.057850 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-83e029bd-a2bb-4f10-b3e5-32121f4eb582 req-1859b5cf-f310-452f-ae58-22f88572d66a service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033315 Jan 25 03:48:55.061239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 696/1460] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:48:55.246802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:55.248493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:55.258156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:55.259548 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:55.262126 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:55.262870 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:55.293750 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:48:55.550162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d7c68158-c734-44cb-958f-ac075cd4ce93 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "DELETE /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 204 len: 0 microversion: 2.1 time: 0.526413 Jan 25 03:48:55.550973 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 765/1461] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:48:55 2022] DELETE /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:48:55.559848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:55.560785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:55.568039 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:55.568746 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:55.569714 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:55.570329 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:55.734300 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:55.743388 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7f2aac77-502e-4ec2-ac88-e50c367c89b5 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1580 microversion: 2.1 time: 0.187322 Jan 25 03:48:55.743905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 697/1462] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:55 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1580 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:56.761006 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:56.761702 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:56.768463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:56.769027 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:56.769794 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:56.770229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:56.898177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:56.905813 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-6a63e66a-bdaf-4526-b8d3-de487f4f30cd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1462 microversion: 2.1 time: 0.148782 Jan 25 03:48:56.906434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 766/1463] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:56 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1462 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:48:57.902968 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-6e6bf55b-19c8-4618-bf7c-c7592e6c1fd5 req-62d2e0db-f4d5-4670-a91d-5ad60c376e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6fc152-dc5c-493a-9933-95f0408e1caa", "name": "network-vif-deleted", "tag": "b92e2cb6-c6e1-4723-843b-37dd1c830bbb"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:48:57.904583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:48:57.904583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:48:57.912614 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-6e6bf55b-19c8-4618-bf7c-c7592e6c1fd5 req-62d2e0db-f4d5-4670-a91d-5ad60c376e9d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:57.913198 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-6e6bf55b-19c8-4618-bf7c-c7592e6c1fd5 req-62d2e0db-f4d5-4670-a91d-5ad60c376e9d service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:57.923005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:57.923637 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:57.926392 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-6e6bf55b-19c8-4618-bf7c-c7592e6c1fd5 req-62d2e0db-f4d5-4670-a91d-5ad60c376e9d service nova] Creating event network-vif-deleted:b92e2cb6-c6e1-4723-843b-37dd1c830bbb for instance 7c6fc152-dc5c-493a-9933-95f0408e1caa on hv-cinder-81901 Jan 25 03:48:57.930917 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:57.931473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:57.931802 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-6e6bf55b-19c8-4618-bf7c-c7592e6c1fd5 req-62d2e0db-f4d5-4670-a91d-5ad60c376e9d service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Jan 25 03:48:57.932205 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:57.932432 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 698/1464] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:48:57.935350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:57.997524 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:58.005543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c0008ab5-88c3-45c6-836a-0b88748db5df tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1396 microversion: 2.1 time: 0.086222 Jan 25 03:48:58.006114 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 767/1465] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:57 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1396 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:48:59.023085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:48:59.023794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:48:59.030449 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:59.030900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:59.031753 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:59.032193 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:59.064179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:48:59.064633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:48:59.065364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lazy-loading 'fault' on Instance uuid 7c6fc152-dc5c-493a-9933-95f0408e1caa {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:48:59.105384 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792e6b0c7c4946ed88fbc454b1779485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe72d0d8d144438a671aac4e939c693', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:48:59.112372 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0730de5a-07e6-4b3e-b67a-90a7f98d4245 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 200 len: 1188 microversion: 2.1 time: 0.093748 Jan 25 03:48:59.115276 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 699/1466] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:48:59 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:00.129183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:00.129796 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: 7c6fc152-dc5c-493a-9933-95f0408e1caa] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:00.136144 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:00.136598 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:00.137376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:00.137818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:00.153070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] HTTP exception thrown: Instance 7c6fc152-dc5c-493a-9933-95f0408e1caa could not be found. Jan 25 03:49:00.153653 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Returning 404 to user: Instance 7c6fc152-dc5c-493a-9933-95f0408e1caa could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:49:00.154468 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-10ea6ddb-9aec-4127-8c5a-3b35121c18da tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa" status: 404 len: 111 microversion: 2.1 time: 0.029774 Jan 25 03:49:00.155006 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 768/1467] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:00 2022] GET /compute/v2.1/servers/7c6fc152-dc5c-493a-9933-95f0408e1caa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:49:00.647146 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:00.647681 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:00.653999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:00.654452 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:00.655305 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:00.655752 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:00.668645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] HTTP exception thrown: Instance ac7ea524-7a77-478b-9894-556c2be34d87 could not be found. Jan 25 03:49:00.669232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Returning 404 to user: Instance ac7ea524-7a77-478b-9894-556c2be34d87 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:49:00.670100 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-76fa9dc6-8cc0-48d4-b036-492739210efd tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "DELETE /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 404 len: 111 microversion: 2.1 time: 0.026678 Jan 25 03:49:00.670632 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 700/1468] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:49:00 2022] DELETE /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 25 03:49:00.679306 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:00.679911 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] [instance: ac7ea524-7a77-478b-9894-556c2be34d87] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:00.685659 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:00.686103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:00.686867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:00.687324 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:00.700571 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] HTTP exception thrown: Instance ac7ea524-7a77-478b-9894-556c2be34d87 could not be found. Jan 25 03:49:00.701141 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Returning 404 to user: Instance ac7ea524-7a77-478b-9894-556c2be34d87 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:49:00.701929 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3dc28d8a-ba84-4a75-bab3-cf15340ea5d6 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87" status: 404 len: 111 microversion: 2.1 time: 0.026641 Jan 25 03:49:00.702433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 769/1469] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:00 2022] GET /compute/v2.1/servers/ac7ea524-7a77-478b-9894-556c2be34d87 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:49:02.124769 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4f99ea05-967a-4415-a704-0c0ed1293459 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] Calling method '.version_select at 0x7f33a8ed93a0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:02.190333 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4f99ea05-967a-4415-a704-0c0ed1293459 tempest-TestVolumeBootPattern-574794776 tempest-TestVolumeBootPattern-574794776-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1048410455" status: 202 len: 0 microversion: 2.1 time: 0.068636 Jan 25 03:49:02.190970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 701/1470] 10.222.0.115 () {58 vars in 1267 bytes} [Tue Jan 25 03:49:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1048410455 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 25 03:49:42.251501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:42.252147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:42.258587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:42.259087 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:42.259901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:42.260344 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:42.341436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lazy-loading 'services' on Instance uuid 1ec9d94c-01db-458b-a8e9-df0d45bf666a {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:49:42.512504 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8bbaaab0-a9bd-4cf5-a915-1e6186ed73a2 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-volume_attachments/a94db642-b724-4083-8666-673f0cc40734" status: 202 len: 0 microversion: 2.1 time: 0.264587 Jan 25 03:49:42.513089 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 770/1471] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:49:42 2022] DELETE /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-volume_attachments/a94db642-b724-4083-8666-673f0cc40734 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:49:43.619980 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-36dfb16e-17ca-43b0-b17c-b89ad16807bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:49:43.625884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-36dfb16e-17ca-43b0-b17c-b89ad16807bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:43.626338 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-36dfb16e-17ca-43b0-b17c-b89ad16807bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:43.650225 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-36dfb16e-17ca-43b0-b17c-b89ad16807bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Going to try to stop instance {{(pid=123363) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 25 03:49:43.796564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-36dfb16e-17ca-43b0-b17c-b89ad16807bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 202 len: 0 microversion: 2.1 time: 0.180853 Jan 25 03:49:43.797099 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 702/1472] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:49:43 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:49:43.807356 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:43.811346 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:43.814138 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:43.814636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:43.815596 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:43.816040 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:43.948954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:43.956406 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-514e0f66-03b7-413a-96eb-71e9202dd61f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.153751 Jan 25 03:49:43.956969 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 771/1473] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:43 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:44.974339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:44.975023 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:44.981510 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:44.981952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:44.982715 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:44.983174 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:45.122419 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:45.130459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-704ebada-9069-48e0-b604-38f6a349237e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.160869 Jan 25 03:49:45.131037 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 703/1474] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:44 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:46.148470 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:46.149091 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:46.155610 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:46.158456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:46.158456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:46.158456 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:46.285294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:46.292579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-534206a1-0449-46c0-a8ad-19c2473910b0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.147835 Jan 25 03:49:46.293146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 772/1475] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:46 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:47.309541 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:47.310149 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:47.317377 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:47.317826 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:47.318595 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:47.319032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:47.451949 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:47.459291 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a8691644-d40d-48e5-9c3f-83936b1d47a6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.153385 Jan 25 03:49:47.459857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 704/1476] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:47 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:48.475780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:48.476532 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:48.482903 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:48.483391 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:48.484204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:48.484646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:48.616595 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:48.623871 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fb8372ae-b035-4c78-8417-3de18338305c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.151781 Jan 25 03:49:48.624435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 773/1477] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:48 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:49.641591 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:49.642195 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:49.648442 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:49.648884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:49.649643 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:49.650072 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:49.775510 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:49.782857 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4d57d645-fae6-4aad-8fc9-1273326246d4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.144909 Jan 25 03:49:49.784040 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 705/1478] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:49 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:50.801028 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:50.801927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:50.808378 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:50.808844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:50.809630 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:50.810073 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:50.944416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:50.951777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7c46f743-49fd-4f0e-b075-6fd6ea734338 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.155220 Jan 25 03:49:50.952345 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 774/1479] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:50 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:51.969356 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:51.969973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:51.976205 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:51.976649 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:51.977416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:51.977844 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:52.105283 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:52.113089 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bcb94ec9-fc03-4db8-9fd7-0c41aa75824f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.147329 Jan 25 03:49:52.113700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 706/1480] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:51 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:53.129183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:53.129795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:53.136178 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:53.136638 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:53.137420 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:53.137866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:53.266715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:53.274674 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5bbade14-6650-4d71-8a16-2ba819a1da2c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.149347 Jan 25 03:49:53.275276 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 775/1481] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:53 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:54.293112 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:54.293750 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:54.300147 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:54.300634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:54.301671 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:54.302102 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:54.442393 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:54.449744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e576bc7e-111e-4426-9fc1-4f547d813533 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1682 microversion: 2.1 time: 0.160515 Jan 25 03:49:54.450354 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 707/1482] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:54 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:55.467036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:55.467611 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:55.474168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:55.474628 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:55.475449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:55.475895 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:55.605723 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:55.613291 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-c3fc0997-f201-4db0-a9fd-a63ec1dcdf11 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1659 microversion: 2.1 time: 0.150026 Jan 25 03:49:55.613861 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 776/1483] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:55 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1659 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:55.629633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d506cc01-f260-43b7-8814-0a3f2ab594a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:49:55.635979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d506cc01-f260-43b7-8814-0a3f2ab594a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:55.636435 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d506cc01-f260-43b7-8814-0a3f2ab594a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:55.657906 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d506cc01-f260-43b7-8814-0a3f2ab594a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Going to try to start instance {{(pid=123363) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 25 03:49:55.819808 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d506cc01-f260-43b7-8814-0a3f2ab594a9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action" status: 202 len: 0 microversion: 2.1 time: 0.194082 Jan 25 03:49:55.820522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 708/1484] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:49:55 2022] POST /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:49:55.828457 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:55.829078 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:55.835632 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:55.836094 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:55.836877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:55.837320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:55.966678 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:55.974358 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f8e49a6a-a6e0-4d02-8dd2-8336f43ea1c1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1668 microversion: 2.1 time: 0.149520 Jan 25 03:49:55.974932 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 777/1485] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:55 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:49:56.992899 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:56.993610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:57.000151 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:57.000611 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:57.001399 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:57.001842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:57.171078 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:57.179480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-59d67905-6da6-4b60-87f5-0dde237bf76d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1668 microversion: 2.1 time: 0.190562 Jan 25 03:49:57.183793 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 709/1486] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:56 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1668 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:49:58.196862 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:49:58.197509 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:49:58.203863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:58.204320 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:58.205107 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:49:58.206162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:49:58.336012 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:49:58.343259 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-894ba118-6aac-452a-ab97-b17d5541a205 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1672 microversion: 2.1 time: 0.150154 Jan 25 03:49:58.343832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 778/1487] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:49:58 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:01.509665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9d684cf9-f76e-4fbb-912b-04c85af1c3d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:01.510577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9d684cf9-f76e-4fbb-912b-04c85af1c3d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:01.516424 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d684cf9-f76e-4fbb-912b-04c85af1c3d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:01.516885 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d684cf9-f76e-4fbb-912b-04c85af1c3d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:01.517659 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d684cf9-f76e-4fbb-912b-04c85af1c3d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:01.518096 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9d684cf9-f76e-4fbb-912b-04c85af1c3d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:01.545928 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9d684cf9-f76e-4fbb-912b-04c85af1c3d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040816 Jan 25 03:51:01.546484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 710/1488] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:51:01 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:01.607774 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:01.608307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:01.614822 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:01.615313 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:01.616095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:01.616536 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:01.641043 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Going to try to terminate instance {{(pid=123362) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:51:01.963698 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-581c979e-79e4-4390-bbb4-0fe7cefcce52 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 204 len: 0 microversion: 2.1 time: 0.360107 Jan 25 03:51:01.964292 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 779/1489] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:51:01 2022] DELETE /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:51:01.972822 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:01.973571 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:01.980032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:01.980507 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:01.981290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:01.981911 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:02.113290 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:02.120519 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-a5ee452b-bb7e-45ed-8c19-dbf6f3608f9b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1678 microversion: 2.1 time: 0.152034 Jan 25 03:51:02.121087 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 711/1490] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:01 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:03.138150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:03.138844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:03.146058 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:03.146512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:03.147308 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:03.147775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:03.278356 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:03.286455 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a914d2bf-1a98-4b38-a670-a25292417932 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1678 microversion: 2.1 time: 0.152275 Jan 25 03:51:03.287025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 780/1491] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:03 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:04.304216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:04.304840 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:04.311669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:04.312117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:04.313668 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:04.314108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:04.527650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:04.535236 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-74c28e85-42f2-450c-af2e-ff9450c4586c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1678 microversion: 2.1 time: 0.234675 Jan 25 03:51:04.535807 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 712/1492] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:04 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:05.221090 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-4fed161b-58ab-467a-a5ee-4a5fecec8fd8 req-490eb293-a951-4bb3-b671-4b9fd96336d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ec9d94c-01db-458b-a8e9-df0d45bf666a", "name": "network-vif-deleted", "tag": "e2b1c0da-6f9d-4323-8052-3159d350939c"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:05.222665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:51:05.222665 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:51:05.230893 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-4fed161b-58ab-467a-a5ee-4a5fecec8fd8 req-490eb293-a951-4bb3-b671-4b9fd96336d7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:05.230996 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-4fed161b-58ab-467a-a5ee-4a5fecec8fd8 req-490eb293-a951-4bb3-b671-4b9fd96336d7 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:05.242650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-4fed161b-58ab-467a-a5ee-4a5fecec8fd8 req-490eb293-a951-4bb3-b671-4b9fd96336d7 service nova] Creating event network-vif-deleted:e2b1c0da-6f9d-4323-8052-3159d350939c for instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a on hv-cinder-81901 Jan 25 03:51:05.248646 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-4fed161b-58ab-467a-a5ee-4a5fecec8fd8 req-490eb293-a951-4bb3-b671-4b9fd96336d7 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 Jan 25 03:51:05.249252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 781/1493] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:51:05.553139 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:05.553773 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:05.560532 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:05.561408 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:05.561848 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:05.562280 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:05.595175 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:05.595533 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:05.595984 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.objects.instance [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lazy-loading 'fault' on Instance uuid 1ec9d94c-01db-458b-a8e9-df0d45bf666a {{(pid=123363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:51:05.636586 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:05.643881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0e5f8763-54e8-4fcd-bd77-97fdf19d65ad tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 200 len: 1331 microversion: 2.1 time: 0.094750 Jan 25 03:51:05.644460 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 713/1494] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:05 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:51:06.661824 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:06.662525 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:06.669017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:06.669473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:06.670246 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:06.670687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:06.684208 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] HTTP exception thrown: Instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a could not be found. Jan 25 03:51:06.684793 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Returning 404 to user: Instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:51:06.685604 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-7d6179a0-5230-4d81-87d0-265248c7484e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 404 len: 111 microversion: 2.1 time: 0.027960 Jan 25 03:51:06.686132 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 782/1495] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:06 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:51:06.694417 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-ddfc3d23-cbe9-4fb1-b4a2-0f8c57d5296f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '.version_select at 0x7f33ad11b5e0>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:06.786708 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-ddfc3d23-cbe9-4fb1-b4a2-0f8c57d5296f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067210611" status: 202 len: 0 microversion: 2.1 time: 0.095841 Jan 25 03:51:06.787321 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 714/1496] 10.222.0.115 () {58 vars in 1225 bytes} [Tue Jan 25 03:51:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067210611 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:51:07.585318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8a67be5a-0c08-4363-a58a-f8fca5d39de1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'create', calling method: .version_select at 0x7f33a846df70>, body: {"keypair": {"name": "tempest-keypair-677902801"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:07.599011 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-8a67be5a-0c08-4363-a58a-f8fca5d39de1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:51:07.602829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-8a67be5a-0c08-4363-a58a-f8fca5d39de1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for user 8a0f2bac18ad4e9191dc4fabea7c6e9f and project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:51:07.814489 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-8a67be5a-0c08-4363-a58a-f8fca5d39de1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:51:07.818590 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.quota [None req-8a67be5a-0c08-4363-a58a-f8fca5d39de1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for user 8a0f2bac18ad4e9191dc4fabea7c6e9f and project bbf2a4190655482593e7a860bbf16549. Resources: {'key_pairs'} {{(pid=123362) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:51:07.832776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8a67be5a-0c08-4363-a58a-f8fca5d39de1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.251124 Jan 25 03:51:07.833379 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 783/1497] 10.222.0.115 () {60 vars in 1162 bytes} [Tue Jan 25 03:51:07 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:09.965099 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1068633005", "imageRef": "c6039e37-c70e-4119-9e20-40343c366c83", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e545c365-d10d-438c-b92f-53b0b77d7557"}], "security_groups": [{"name": "tempest-securitygroup--608046715"}], "key_name": "tempest-keypair-677902801", "user_data": "}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:10.076181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.network.neutron [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] validate_networks() for [('e545c365-d10d-438c-b92f-53b0b77d7557', None, None, None, None, None)] {{(pid=123363) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 25 03:51:10.521227 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Flavor limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 25 03:51:10.521687 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Image limits 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 25 03:51:10.522168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Flavor pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 25 03:51:10.522583 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Image pref 0:0:0 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 25 03:51:10.523047 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.virt.hardware [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 25 03:51:10.533645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:10.534429 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:10.535563 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:10.552767 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:10.553042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for project bbf2a4190655482593e7a860bbf16549. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 25 03:51:10.557823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.quota [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Getting quotas for user 8a0f2bac18ad4e9191dc4fabea7c6e9f and project bbf2a4190655482593e7a860bbf16549. Resources: {'instances', 'cores', 'ram'} {{(pid=123363) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 25 03:51:10.570106 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Going to run 1 instances... {{(pid=123363) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 25 03:51:10.576042 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6039e37-c70e-4119-9e20-40343c366c83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 25 03:51:10.706548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-1d582abe-652a-4b3a-8326-e0c388cee9f4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.746013 Jan 25 03:51:10.707220 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 715/1498] 10.222.0.115 () {60 vars in 1151 bytes} [Tue Jan 25 03:51:09 2022] POST /compute/v2.1/servers => generated 403 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 25 03:51:10.717310 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d8c1e6bd-d82b-4212-b3f8-791313ea9536 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:10.717926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d8c1e6bd-d82b-4212-b3f8-791313ea9536 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:10.771551 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-d8c1e6bd-d82b-4212-b3f8-791313ea9536 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:10.778192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d8c1e6bd-d82b-4212-b3f8-791313ea9536 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1241 microversion: 2.1 time: 0.064983 Jan 25 03:51:10.778756 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 784/1499] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:10 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:11.794832 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:11.795439 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:11.804112 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:11.804564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:11.805346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:11.805779 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:11.864546 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:11.871810 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-37d81e6f-0f97-436f-a48f-988ca5492800 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1245 microversion: 2.1 time: 0.081216 Jan 25 03:51:11.872433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 716/1500] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:11 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:12.889950 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:12.891529 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:12.898299 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:12.898758 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:12.899587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:12.900034 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:12.969175 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:12.977295 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-3a17cfdc-dc12-4bed-b153-fe3a6b23cf7b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1301 microversion: 2.1 time: 0.090946 Jan 25 03:51:12.978145 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 785/1501] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:12 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:13.994866 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:13.995639 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:14.002400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:14.002927 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:14.003823 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:14.004328 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:14.217718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:14.224920 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-22aa31ca-f824-4ea7-9a6d-8dc3822d6508 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.233892 Jan 25 03:51:14.225521 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 717/1502] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:13 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:14.683038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [req-2a4d5882-839f-47f5-b556-1b21a74fd75a req-baac1ccc-ca70-47c1-bbdf-d2c939604d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d73c28-93e8-4330-95de-2a53b381f015", "tag": "c359d790-25d3-4bb1-8056-5d009e88aa16"}]} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:14.685696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:51:14.685696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: warnings.warn(msg) Jan 25 03:51:14.698204 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-2a4d5882-839f-47f5-b556-1b21a74fd75a req-baac1ccc-ca70-47c1-bbdf-d2c939604d44 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:14.698856 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [req-2a4d5882-839f-47f5-b556-1b21a74fd75a req-baac1ccc-ca70-47c1-bbdf-d2c939604d44 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:14.711544 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.compute.server_external_events [req-2a4d5882-839f-47f5-b556-1b21a74fd75a req-baac1ccc-ca70-47c1-bbdf-d2c939604d44 service nova] Creating event network-changed:c359d790-25d3-4bb1-8056-5d009e88aa16 for instance 23d73c28-93e8-4330-95de-2a53b381f015 on hv-cinder-81901 Jan 25 03:51:14.717233 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [req-2a4d5882-839f-47f5-b556-1b21a74fd75a req-baac1ccc-ca70-47c1-bbdf-d2c939604d44 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037592 Jan 25 03:51:14.717866 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 786/1503] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:51:15.242070 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:15.242907 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:15.249378 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:15.253116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:15.253116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:15.253116 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:15.494057 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:15.501271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0d2931a5-9cb6-46dd-8aba-c91db6f2f0f3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.263161 Jan 25 03:51:15.501835 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 718/1504] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:15 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:16.517887 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:16.518581 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:16.524670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:16.525119 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:16.525885 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:16.526314 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:16.658587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:16.665761 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2b846af3-1c76-4bee-86b1-dcbcbcf6fb44 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.152460 Jan 25 03:51:16.666324 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 787/1505] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:16 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:17.682954 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:17.683582 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:17.690454 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:17.690898 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:17.691744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:17.692177 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:17.829974 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:17.837108 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-d63a3c8f-26c2-4053-8d27-bf7e53854c9c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.157801 Jan 25 03:51:17.837670 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 719/1506] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:17 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:18.853541 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:18.854157 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:18.861603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:18.862062 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:18.862850 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:18.863319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:18.990488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:18.997872 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-fcf1b659-dab6-4751-816d-e130053a5133 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.147995 Jan 25 03:51:18.998449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 788/1507] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:18 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:20.014893 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:20.016168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:20.022352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:20.022806 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:20.023622 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:20.024062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:20.157761 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:20.164902 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-990ea130-1a0d-4d6b-9b46-ba8cf19d38ed tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.153777 Jan 25 03:51:20.165468 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 720/1508] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:20 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:21.184199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:21.185146 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:21.191800 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:21.192183 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:21.192974 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:21.193419 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:21.303000 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-30ed17d8-9430-49f3-861f-d63ab9e01743 req-7f359751-c234-44a8-8883-9b106cad3814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d73c28-93e8-4330-95de-2a53b381f015", "name": "network-vif-plugged", "status": "completed", "tag": "c359d790-25d3-4bb1-8056-5d009e88aa16"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:21.305125 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:51:21.305125 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:51:21.314932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-30ed17d8-9430-49f3-861f-d63ab9e01743 req-7f359751-c234-44a8-8883-9b106cad3814 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:21.315413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-30ed17d8-9430-49f3-861f-d63ab9e01743 req-7f359751-c234-44a8-8883-9b106cad3814 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:21.326394 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-30ed17d8-9430-49f3-861f-d63ab9e01743 req-7f359751-c234-44a8-8883-9b106cad3814 service nova] Creating event network-vif-plugged:c359d790-25d3-4bb1-8056-5d009e88aa16 for instance 23d73c28-93e8-4330-95de-2a53b381f015 on hv-cinder-81901 Jan 25 03:51:21.332291 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-30ed17d8-9430-49f3-861f-d63ab9e01743 req-7f359751-c234-44a8-8883-9b106cad3814 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033818 Jan 25 03:51:21.332895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 721/1509] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 25 03:51:21.492318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:21.499700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-76334b79-2424-40e7-8d91-8ce971afbf08 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.321401 Jan 25 03:51:21.500360 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 789/1510] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:21 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:22.517184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:22.517877 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:22.524015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:22.524467 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:22.525232 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:22.525669 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:22.710522 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:22.717946 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0a304936-ca26-4e07-8e08-543fc25c9b09 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1366 microversion: 2.1 time: 0.205607 Jan 25 03:51:22.718632 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 722/1511] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:22 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:23.734508 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:23.735141 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:23.741436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:23.741897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:23.742673 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:23.743147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:23.869686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:51:23.877393 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-627f1875-cd52-4616-99d5-c11c1cd55ed8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1552 microversion: 2.1 time: 0.146631 Jan 25 03:51:23.877965 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 790/1512] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:51:23 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:23.893953 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7692a30f-f5e7-4194-8c3a-006f83bb01bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:51:23.894484 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7692a30f-f5e7-4194-8c3a-006f83bb01bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:23.900699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7692a30f-f5e7-4194-8c3a-006f83bb01bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:23.901150 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7692a30f-f5e7-4194-8c3a-006f83bb01bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:23.901922 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7692a30f-f5e7-4194-8c3a-006f83bb01bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:23.902356 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7692a30f-f5e7-4194-8c3a-006f83bb01bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:23.980346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7692a30f-f5e7-4194-8c3a-006f83bb01bf tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091040 Jan 25 03:51:23.980952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 723/1513] 10.222.0.115 () {58 vars in 1279 bytes} [Tue Jan 25 03:51:23 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:51:24.956198 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-01f801db-d331-4924-a399-9384922a47b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:24.957111 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-01f801db-d331-4924-a399-9384922a47b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:24.962812 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-cbd78df5-ca52-4161-bcd7-ade6c8f3de35 req-d49c2a3d-83c7-4ad3-a7be-f536a71164bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d73c28-93e8-4330-95de-2a53b381f015", "tag": "c359d790-25d3-4bb1-8056-5d009e88aa16"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:24.964344 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:51:24.964344 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:51:24.972912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01f801db-d331-4924-a399-9384922a47b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:24.973376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01f801db-d331-4924-a399-9384922a47b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:24.973924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-cbd78df5-ca52-4161-bcd7-ade6c8f3de35 req-d49c2a3d-83c7-4ad3-a7be-f536a71164bb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:24.974633 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-cbd78df5-ca52-4161-bcd7-ade6c8f3de35 req-d49c2a3d-83c7-4ad3-a7be-f536a71164bb service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:24.974782 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01f801db-d331-4924-a399-9384922a47b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:24.975343 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-01f801db-d331-4924-a399-9384922a47b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:24.985918 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-cbd78df5-ca52-4161-bcd7-ade6c8f3de35 req-d49c2a3d-83c7-4ad3-a7be-f536a71164bb service nova] Creating event network-changed:c359d790-25d3-4bb1-8056-5d009e88aa16 for instance 23d73c28-93e8-4330-95de-2a53b381f015 on hv-cinder-81901 Jan 25 03:51:24.991990 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-cbd78df5-ca52-4161-bcd7-ade6c8f3de35 req-d49c2a3d-83c7-4ad3-a7be-f536a71164bb service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033029 Jan 25 03:51:24.993427 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 724/1514] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:51:25.072748 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-01f801db-d331-4924-a399-9384922a47b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.121892 Jan 25 03:51:25.073852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 791/1515] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:24 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:26.086956 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-640071fb-7770-450b-b110-7019a26ba230 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:26.089813 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-640071fb-7770-450b-b110-7019a26ba230 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:26.098963 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-640071fb-7770-450b-b110-7019a26ba230 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:26.099450 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-640071fb-7770-450b-b110-7019a26ba230 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:26.100259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-640071fb-7770-450b-b110-7019a26ba230 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:26.100688 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-640071fb-7770-450b-b110-7019a26ba230 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:26.182275 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-640071fb-7770-450b-b110-7019a26ba230 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.100909 Jan 25 03:51:26.182919 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 725/1516] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:26 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:27.194721 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-97676851-6a8f-465e-9b3f-a279adf5a6d8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:27.195863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-97676851-6a8f-465e-9b3f-a279adf5a6d8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:27.207005 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97676851-6a8f-465e-9b3f-a279adf5a6d8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:27.207518 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97676851-6a8f-465e-9b3f-a279adf5a6d8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:27.208336 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97676851-6a8f-465e-9b3f-a279adf5a6d8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:27.208780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-97676851-6a8f-465e-9b3f-a279adf5a6d8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:27.295436 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-97676851-6a8f-465e-9b3f-a279adf5a6d8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.104934 Jan 25 03:51:27.296088 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 792/1517] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:27 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:28.307030 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-bbbcc1c3-f2a0-47ac-825d-93eb015e4535 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:28.307981 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-bbbcc1c3-f2a0-47ac-825d-93eb015e4535 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:28.315076 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bbbcc1c3-f2a0-47ac-825d-93eb015e4535 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:28.315539 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bbbcc1c3-f2a0-47ac-825d-93eb015e4535 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:28.316314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bbbcc1c3-f2a0-47ac-825d-93eb015e4535 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:28.316760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-bbbcc1c3-f2a0-47ac-825d-93eb015e4535 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:28.402088 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-bbbcc1c3-f2a0-47ac-825d-93eb015e4535 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.099009 Jan 25 03:51:28.402758 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 726/1518] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:28 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:29.418052 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e569f744-6316-4e30-b557-23edc70f63f1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:29.419037 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e569f744-6316-4e30-b557-23edc70f63f1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:29.426137 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e569f744-6316-4e30-b557-23edc70f63f1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:29.426592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e569f744-6316-4e30-b557-23edc70f63f1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:29.427382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e569f744-6316-4e30-b557-23edc70f63f1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:29.427818 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e569f744-6316-4e30-b557-23edc70f63f1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:29.506243 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e569f744-6316-4e30-b557-23edc70f63f1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.091934 Jan 25 03:51:29.506795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 793/1519] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:29 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:30.518413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-0c28b49c-2fa2-4a3c-8d17-ca6df7f5fe32 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:30.519449 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-0c28b49c-2fa2-4a3c-8d17-ca6df7f5fe32 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:30.526336 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c28b49c-2fa2-4a3c-8d17-ca6df7f5fe32 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:30.526779 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c28b49c-2fa2-4a3c-8d17-ca6df7f5fe32 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:30.527565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c28b49c-2fa2-4a3c-8d17-ca6df7f5fe32 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:30.528001 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-0c28b49c-2fa2-4a3c-8d17-ca6df7f5fe32 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:30.606584 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-0c28b49c-2fa2-4a3c-8d17-ca6df7f5fe32 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.092335 Jan 25 03:51:30.607168 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 727/1520] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:30 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:31.618363 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-17ee4fb0-63d2-4a83-a30b-93f4155cf0fd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:31.619311 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-17ee4fb0-63d2-4a83-a30b-93f4155cf0fd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:31.626247 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17ee4fb0-63d2-4a83-a30b-93f4155cf0fd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:31.626693 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17ee4fb0-63d2-4a83-a30b-93f4155cf0fd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:31.627495 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17ee4fb0-63d2-4a83-a30b-93f4155cf0fd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:31.627927 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-17ee4fb0-63d2-4a83-a30b-93f4155cf0fd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:31.724377 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-17ee4fb0-63d2-4a83-a30b-93f4155cf0fd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.109922 Jan 25 03:51:31.724990 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 794/1521] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:31 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:32.735882 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-42644e57-181f-4a8e-86d6-e89fcab3b12a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:32.736867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-42644e57-181f-4a8e-86d6-e89fcab3b12a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:32.743666 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42644e57-181f-4a8e-86d6-e89fcab3b12a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:32.744112 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42644e57-181f-4a8e-86d6-e89fcab3b12a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:32.744893 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42644e57-181f-4a8e-86d6-e89fcab3b12a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:32.745324 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-42644e57-181f-4a8e-86d6-e89fcab3b12a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:32.834784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-42644e57-181f-4a8e-86d6-e89fcab3b12a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.103337 Jan 25 03:51:32.835602 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 728/1522] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:32 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:33.846153 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1e4452c7-2bad-4044-9dd7-0864103016d1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:33.847156 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1e4452c7-2bad-4044-9dd7-0864103016d1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:33.853977 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e4452c7-2bad-4044-9dd7-0864103016d1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:33.854432 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e4452c7-2bad-4044-9dd7-0864103016d1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:33.855231 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e4452c7-2bad-4044-9dd7-0864103016d1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:33.855668 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e4452c7-2bad-4044-9dd7-0864103016d1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:33.935554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1e4452c7-2bad-4044-9dd7-0864103016d1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 14 microversion: 2.1 time: 0.093380 Jan 25 03:51:33.936859 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 795/1523] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:33 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:51:34.947433 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f8aaf055-a92b-4dac-a379-37c37d935aec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:34.948420 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f8aaf055-a92b-4dac-a379-37c37d935aec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:34.955415 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f8aaf055-a92b-4dac-a379-37c37d935aec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:34.955858 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f8aaf055-a92b-4dac-a379-37c37d935aec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:34.956619 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f8aaf055-a92b-4dac-a379-37c37d935aec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:34.957046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f8aaf055-a92b-4dac-a379-37c37d935aec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:35.062819 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f8aaf055-a92b-4dac-a379-37c37d935aec tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 7546 microversion: 2.1 time: 0.119302 Jan 25 03:51:35.063679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 729/1524] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:34 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 7546 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:51:36.074218 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-83b073f9-1f96-41a1-93d1-b9b32818468b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:36.075249 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-83b073f9-1f96-41a1-93d1-b9b32818468b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:36.082227 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83b073f9-1f96-41a1-93d1-b9b32818468b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:36.082683 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83b073f9-1f96-41a1-93d1-b9b32818468b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:36.083490 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83b073f9-1f96-41a1-93d1-b9b32818468b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:36.083935 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-83b073f9-1f96-41a1-93d1-b9b32818468b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:36.176585 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-83b073f9-1f96-41a1-93d1-b9b32818468b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 16196 microversion: 2.1 time: 0.106255 Jan 25 03:51:36.177229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 796/1525] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:36 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 16196 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:37.188929 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-23f1b8a2-6493-4966-af6d-a21f973b615d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:37.189924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-23f1b8a2-6493-4966-af6d-a21f973b615d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:37.196944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-23f1b8a2-6493-4966-af6d-a21f973b615d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:37.197396 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-23f1b8a2-6493-4966-af6d-a21f973b615d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:37.198182 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-23f1b8a2-6493-4966-af6d-a21f973b615d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:37.198621 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-23f1b8a2-6493-4966-af6d-a21f973b615d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:37.297049 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-23f1b8a2-6493-4966-af6d-a21f973b615d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 18561 microversion: 2.1 time: 0.112266 Jan 25 03:51:37.297973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 730/1526] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:37 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 18561 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:38.309130 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-dc84e514-39db-4fab-bf9d-a026b32abe90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:38.310038 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-dc84e514-39db-4fab-bf9d-a026b32abe90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:38.317483 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dc84e514-39db-4fab-bf9d-a026b32abe90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:38.317934 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dc84e514-39db-4fab-bf9d-a026b32abe90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:38.318696 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dc84e514-39db-4fab-bf9d-a026b32abe90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:38.319169 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-dc84e514-39db-4fab-bf9d-a026b32abe90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:38.422189 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-dc84e514-39db-4fab-bf9d-a026b32abe90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 20915 microversion: 2.1 time: 0.116945 Jan 25 03:51:38.423115 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 797/1527] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:38 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 20915 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:39.434271 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fe3a4ee0-6dfe-4a6d-afd6-271b44eb6337 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:39.435327 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fe3a4ee0-6dfe-4a6d-afd6-271b44eb6337 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:39.442493 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fe3a4ee0-6dfe-4a6d-afd6-271b44eb6337 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:39.442944 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fe3a4ee0-6dfe-4a6d-afd6-271b44eb6337 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:39.443749 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fe3a4ee0-6dfe-4a6d-afd6-271b44eb6337 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:39.444193 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fe3a4ee0-6dfe-4a6d-afd6-271b44eb6337 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:39.533908 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fe3a4ee0-6dfe-4a6d-afd6-271b44eb6337 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 22949 microversion: 2.1 time: 0.103480 Jan 25 03:51:39.534459 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 731/1528] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:39 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 22949 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:40.599963 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9258665d-a6a0-41fd-a509-e74611d744b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:40.600997 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9258665d-a6a0-41fd-a509-e74611d744b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:40.607952 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9258665d-a6a0-41fd-a509-e74611d744b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:40.609081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9258665d-a6a0-41fd-a509-e74611d744b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:40.609852 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9258665d-a6a0-41fd-a509-e74611d744b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:40.610287 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9258665d-a6a0-41fd-a509-e74611d744b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:40.698229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9258665d-a6a0-41fd-a509-e74611d744b1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 24541 microversion: 2.1 time: 0.156233 Jan 25 03:51:40.698859 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 798/1529] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:40 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 24541 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:41.710646 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-57d66de1-83d9-4806-a035-3aa2b6bc4f1d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:41.711664 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-57d66de1-83d9-4806-a035-3aa2b6bc4f1d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:41.719207 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57d66de1-83d9-4806-a035-3aa2b6bc4f1d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:41.719650 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57d66de1-83d9-4806-a035-3aa2b6bc4f1d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:41.720413 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57d66de1-83d9-4806-a035-3aa2b6bc4f1d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:41.720842 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-57d66de1-83d9-4806-a035-3aa2b6bc4f1d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:41.807924 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-57d66de1-83d9-4806-a035-3aa2b6bc4f1d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 26207 microversion: 2.1 time: 0.101138 Jan 25 03:51:41.808584 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 732/1530] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:41 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 26207 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:42.820694 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5178698f-d1df-42c8-9be2-2b40717f03ac tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:42.821695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5178698f-d1df-42c8-9be2-2b40717f03ac tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:42.828634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5178698f-d1df-42c8-9be2-2b40717f03ac tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:42.829099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5178698f-d1df-42c8-9be2-2b40717f03ac tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:42.829878 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5178698f-d1df-42c8-9be2-2b40717f03ac tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:42.830322 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5178698f-d1df-42c8-9be2-2b40717f03ac tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:42.927869 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5178698f-d1df-42c8-9be2-2b40717f03ac tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 27466 microversion: 2.1 time: 0.111028 Jan 25 03:51:42.928506 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 799/1531] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:42 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 27466 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:43.940607 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2cc1c21a-e4fc-48b0-83e7-e55fdb6b6175 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:43.941600 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2cc1c21a-e4fc-48b0-83e7-e55fdb6b6175 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:43.948422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2cc1c21a-e4fc-48b0-83e7-e55fdb6b6175 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:43.948871 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2cc1c21a-e4fc-48b0-83e7-e55fdb6b6175 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:43.949635 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2cc1c21a-e4fc-48b0-83e7-e55fdb6b6175 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:43.950061 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2cc1c21a-e4fc-48b0-83e7-e55fdb6b6175 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:44.049371 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2cc1c21a-e4fc-48b0-83e7-e55fdb6b6175 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 27874 microversion: 2.1 time: 0.113163 Jan 25 03:51:44.050188 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 733/1532] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:43 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 27874 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:45.061940 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-50a69cf9-2776-445e-9bb4-58739fb8d3c5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:45.063001 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-50a69cf9-2776-445e-9bb4-58739fb8d3c5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:45.069842 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50a69cf9-2776-445e-9bb4-58739fb8d3c5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:45.070297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50a69cf9-2776-445e-9bb4-58739fb8d3c5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:45.071095 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50a69cf9-2776-445e-9bb4-58739fb8d3c5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:45.071540 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-50a69cf9-2776-445e-9bb4-58739fb8d3c5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:45.161868 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-50a69cf9-2776-445e-9bb4-58739fb8d3c5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.104545 Jan 25 03:51:45.162586 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 800/1533] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:45 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:46.174795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-43345aec-e7fb-496a-955c-9e8437e4d804 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:46.175872 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-43345aec-e7fb-496a-955c-9e8437e4d804 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:46.182784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43345aec-e7fb-496a-955c-9e8437e4d804 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:46.183279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43345aec-e7fb-496a-955c-9e8437e4d804 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:46.184056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43345aec-e7fb-496a-955c-9e8437e4d804 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:46.184495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-43345aec-e7fb-496a-955c-9e8437e4d804 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:46.273817 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-43345aec-e7fb-496a-955c-9e8437e4d804 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.103807 Jan 25 03:51:46.274455 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 734/1534] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:46 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:47.286099 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-800042ed-78cf-4308-ac0b-665b1ec2d32c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:47.287131 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-800042ed-78cf-4308-ac0b-665b1ec2d32c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:47.294082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-800042ed-78cf-4308-ac0b-665b1ec2d32c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:47.296425 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-800042ed-78cf-4308-ac0b-665b1ec2d32c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:47.296425 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-800042ed-78cf-4308-ac0b-665b1ec2d32c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:47.296650 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-800042ed-78cf-4308-ac0b-665b1ec2d32c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:47.376687 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-800042ed-78cf-4308-ac0b-665b1ec2d32c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.094464 Jan 25 03:51:47.377334 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 801/1535] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:47 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:48.388143 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9405534d-d830-47ef-987f-3617a0de3822 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:48.389789 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9405534d-d830-47ef-987f-3617a0de3822 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:48.396946 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9405534d-d830-47ef-987f-3617a0de3822 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:48.397387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9405534d-d830-47ef-987f-3617a0de3822 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:48.398155 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9405534d-d830-47ef-987f-3617a0de3822 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:48.398587 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9405534d-d830-47ef-987f-3617a0de3822 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:48.486185 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9405534d-d830-47ef-987f-3617a0de3822 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.102056 Jan 25 03:51:48.487103 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 735/1536] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:48 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:49.498795 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-14f21d0b-18a3-4c37-b93c-04224437b889 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:49.499732 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-14f21d0b-18a3-4c37-b93c-04224437b889 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:49.507262 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f21d0b-18a3-4c37-b93c-04224437b889 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:49.507713 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f21d0b-18a3-4c37-b93c-04224437b889 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:49.508486 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f21d0b-18a3-4c37-b93c-04224437b889 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:49.508923 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-14f21d0b-18a3-4c37-b93c-04224437b889 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:49.594531 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-14f21d0b-18a3-4c37-b93c-04224437b889 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.100022 Jan 25 03:51:49.595256 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 802/1537] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:49 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:50.606387 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-17cea959-6a2f-4701-beec-557c833e4838 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:50.607343 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-17cea959-6a2f-4701-beec-557c833e4838 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:50.614935 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-17cea959-6a2f-4701-beec-557c833e4838 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:50.615423 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-17cea959-6a2f-4701-beec-557c833e4838 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:50.616239 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-17cea959-6a2f-4701-beec-557c833e4838 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:50.616682 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-17cea959-6a2f-4701-beec-557c833e4838 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:50.702476 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-17cea959-6a2f-4701-beec-557c833e4838 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.100176 Jan 25 03:51:50.703130 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 736/1538] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:50 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:51.714421 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1e70f0bd-7642-4387-925f-14bb52d6a0fa tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:51.715476 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1e70f0bd-7642-4387-925f-14bb52d6a0fa tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:51.723284 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e70f0bd-7642-4387-925f-14bb52d6a0fa tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:51.724064 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e70f0bd-7642-4387-925f-14bb52d6a0fa tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:51.725493 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e70f0bd-7642-4387-925f-14bb52d6a0fa tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:51.726056 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1e70f0bd-7642-4387-925f-14bb52d6a0fa tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:51.812071 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1e70f0bd-7642-4387-925f-14bb52d6a0fa tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.100601 Jan 25 03:51:51.812731 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 803/1539] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:51 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:52.824107 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-14ff717e-ccba-4f7e-8457-3a885af7f8cc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:52.825110 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-14ff717e-ccba-4f7e-8457-3a885af7f8cc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:52.832098 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14ff717e-ccba-4f7e-8457-3a885af7f8cc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:52.832551 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14ff717e-ccba-4f7e-8457-3a885af7f8cc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:52.833339 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14ff717e-ccba-4f7e-8457-3a885af7f8cc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:52.833778 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-14ff717e-ccba-4f7e-8457-3a885af7f8cc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:52.915456 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-14ff717e-ccba-4f7e-8457-3a885af7f8cc tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.095226 Jan 25 03:51:52.916090 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 737/1540] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:52 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:53.927846 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8690e63d-8e17-42d1-96ab-5f5d02729e80 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:53.928855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8690e63d-8e17-42d1-96ab-5f5d02729e80 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:53.935707 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8690e63d-8e17-42d1-96ab-5f5d02729e80 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:53.936168 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8690e63d-8e17-42d1-96ab-5f5d02729e80 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:53.936947 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8690e63d-8e17-42d1-96ab-5f5d02729e80 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:53.937390 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8690e63d-8e17-42d1-96ab-5f5d02729e80 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:54.020668 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8690e63d-8e17-42d1-96ab-5f5d02729e80 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.096750 Jan 25 03:51:54.021611 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 804/1541] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:53 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:51:55.033895 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9289b135-2741-438f-9809-60ee9102d11c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:55.034802 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9289b135-2741-438f-9809-60ee9102d11c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:55.041718 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9289b135-2741-438f-9809-60ee9102d11c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:55.042166 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9289b135-2741-438f-9809-60ee9102d11c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:55.042939 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9289b135-2741-438f-9809-60ee9102d11c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:55.043404 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9289b135-2741-438f-9809-60ee9102d11c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:55.130152 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9289b135-2741-438f-9809-60ee9102d11c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28235 microversion: 2.1 time: 0.101000 Jan 25 03:51:55.130806 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 738/1542] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:55 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:56.142501 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d60cd521-ec88-40ac-896d-90764f1c8914 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:56.143528 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d60cd521-ec88-40ac-896d-90764f1c8914 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:56.150401 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d60cd521-ec88-40ac-896d-90764f1c8914 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:56.150829 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d60cd521-ec88-40ac-896d-90764f1c8914 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:56.151638 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d60cd521-ec88-40ac-896d-90764f1c8914 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:56.152082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d60cd521-ec88-40ac-896d-90764f1c8914 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:56.255703 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d60cd521-ec88-40ac-896d-90764f1c8914 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28446 microversion: 2.1 time: 0.117543 Jan 25 03:51:56.256376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 805/1543] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:56 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:57.268683 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-3b3b7db9-3157-4924-8bae-903b7c39bea6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:57.269798 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-3b3b7db9-3157-4924-8bae-903b7c39bea6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:57.276853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b3b7db9-3157-4924-8bae-903b7c39bea6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:57.277312 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b3b7db9-3157-4924-8bae-903b7c39bea6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:57.278106 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b3b7db9-3157-4924-8bae-903b7c39bea6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:57.278541 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-3b3b7db9-3157-4924-8bae-903b7c39bea6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:57.371728 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-3b3b7db9-3157-4924-8bae-903b7c39bea6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28526 microversion: 2.1 time: 0.107673 Jan 25 03:51:57.372611 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 739/1544] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:57 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28526 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:58.384349 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e8f5e718-ef64-4b52-8e2f-70cfd7603e82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:58.385382 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e8f5e718-ef64-4b52-8e2f-70cfd7603e82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:58.392242 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8f5e718-ef64-4b52-8e2f-70cfd7603e82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:58.392700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8f5e718-ef64-4b52-8e2f-70cfd7603e82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:58.393480 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8f5e718-ef64-4b52-8e2f-70cfd7603e82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:58.393923 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e8f5e718-ef64-4b52-8e2f-70cfd7603e82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:58.496232 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e8f5e718-ef64-4b52-8e2f-70cfd7603e82 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.115715 Jan 25 03:51:58.497162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 806/1545] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:58 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:51:59.509184 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-9db9b81b-ef4b-4f5c-9a6f-cf9a30034650 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:51:59.510118 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-9db9b81b-ef4b-4f5c-9a6f-cf9a30034650 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:51:59.518365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9db9b81b-ef4b-4f5c-9a6f-cf9a30034650 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:59.518814 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9db9b81b-ef4b-4f5c-9a6f-cf9a30034650 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:59.519624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9db9b81b-ef4b-4f5c-9a6f-cf9a30034650 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:51:59.520068 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-9db9b81b-ef4b-4f5c-9a6f-cf9a30034650 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:51:59.605117 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-9db9b81b-ef4b-4f5c-9a6f-cf9a30034650 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.100015 Jan 25 03:51:59.605760 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 740/1546] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:51:59 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:00.617471 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-063711a7-4776-47f3-8d74-c278cbb0800e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:00.618416 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-063711a7-4776-47f3-8d74-c278cbb0800e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:00.626039 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063711a7-4776-47f3-8d74-c278cbb0800e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:00.626492 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063711a7-4776-47f3-8d74-c278cbb0800e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:00.627302 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063711a7-4776-47f3-8d74-c278cbb0800e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:00.627802 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-063711a7-4776-47f3-8d74-c278cbb0800e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:00.709944 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-063711a7-4776-47f3-8d74-c278cbb0800e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.096489 Jan 25 03:52:00.710832 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 807/1547] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:00 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:01.722645 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-54adac25-14e3-4f27-8f2c-a58dd240fa67 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:01.723934 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-54adac25-14e3-4f27-8f2c-a58dd240fa67 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:01.730905 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54adac25-14e3-4f27-8f2c-a58dd240fa67 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:01.731365 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54adac25-14e3-4f27-8f2c-a58dd240fa67 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:01.732128 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54adac25-14e3-4f27-8f2c-a58dd240fa67 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:01.732588 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-54adac25-14e3-4f27-8f2c-a58dd240fa67 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:01.823719 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-54adac25-14e3-4f27-8f2c-a58dd240fa67 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.105240 Jan 25 03:52:01.824364 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 741/1548] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:01 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:02.835725 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-804e10a7-6036-4e1e-b507-50b4a0623267 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:02.836722 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-804e10a7-6036-4e1e-b507-50b4a0623267 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:02.844614 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-804e10a7-6036-4e1e-b507-50b4a0623267 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:02.845070 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-804e10a7-6036-4e1e-b507-50b4a0623267 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:02.845851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-804e10a7-6036-4e1e-b507-50b4a0623267 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:02.846294 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-804e10a7-6036-4e1e-b507-50b4a0623267 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:02.933319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-804e10a7-6036-4e1e-b507-50b4a0623267 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.101539 Jan 25 03:52:02.933980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 808/1549] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:02 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:03.945565 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-f3eafd70-8eeb-42d4-b84a-d1197d0ae06e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:03.946564 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-f3eafd70-8eeb-42d4-b84a-d1197d0ae06e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:03.953482 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f3eafd70-8eeb-42d4-b84a-d1197d0ae06e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:03.953930 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f3eafd70-8eeb-42d4-b84a-d1197d0ae06e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:03.954705 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f3eafd70-8eeb-42d4-b84a-d1197d0ae06e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:03.955173 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-f3eafd70-8eeb-42d4-b84a-d1197d0ae06e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:04.039634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-f3eafd70-8eeb-42d4-b84a-d1197d0ae06e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.097958 Jan 25 03:52:04.040227 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 742/1550] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:03 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:05.051954 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-2fcade12-dbe6-4e97-9c90-e876266eb757 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:05.052959 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-2fcade12-dbe6-4e97-9c90-e876266eb757 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:05.059855 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fcade12-dbe6-4e97-9c90-e876266eb757 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:05.060314 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fcade12-dbe6-4e97-9c90-e876266eb757 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:05.061100 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fcade12-dbe6-4e97-9c90-e876266eb757 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:05.061543 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-2fcade12-dbe6-4e97-9c90-e876266eb757 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:05.142289 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-2fcade12-dbe6-4e97-9c90-e876266eb757 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.094258 Jan 25 03:52:05.142910 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 809/1551] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:05 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:06.153992 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-7674a716-327f-4997-aab2-a822df0e882c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:06.154985 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-7674a716-327f-4997-aab2-a822df0e882c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:06.162181 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7674a716-327f-4997-aab2-a822df0e882c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:06.162642 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7674a716-327f-4997-aab2-a822df0e882c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:06.163474 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7674a716-327f-4997-aab2-a822df0e882c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:06.163916 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-7674a716-327f-4997-aab2-a822df0e882c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:06.248872 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-7674a716-327f-4997-aab2-a822df0e882c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.098773 Jan 25 03:52:06.250085 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 743/1552] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:06 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:07.261565 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-732c8db1-923c-4ed2-b2a6-4e1a7bfd8299 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:07.262555 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-732c8db1-923c-4ed2-b2a6-4e1a7bfd8299 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:07.270031 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-732c8db1-923c-4ed2-b2a6-4e1a7bfd8299 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:07.270484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-732c8db1-923c-4ed2-b2a6-4e1a7bfd8299 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:07.271281 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-732c8db1-923c-4ed2-b2a6-4e1a7bfd8299 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:07.271717 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-732c8db1-923c-4ed2-b2a6-4e1a7bfd8299 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:07.355880 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-732c8db1-923c-4ed2-b2a6-4e1a7bfd8299 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.098123 Jan 25 03:52:07.356807 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 810/1553] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:07 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:08.367853 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2aa471a0-ec50-4bcb-9704-5121f389d0d6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:08.368859 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2aa471a0-ec50-4bcb-9704-5121f389d0d6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:08.377049 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2aa471a0-ec50-4bcb-9704-5121f389d0d6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:08.377505 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2aa471a0-ec50-4bcb-9704-5121f389d0d6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:08.378298 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2aa471a0-ec50-4bcb-9704-5121f389d0d6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:08.378733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2aa471a0-ec50-4bcb-9704-5121f389d0d6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:08.461400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2aa471a0-ec50-4bcb-9704-5121f389d0d6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.097492 Jan 25 03:52:08.462031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 744/1554] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:08 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:09.473557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f718e545-3743-4bc6-b586-12c9787ceed3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:09.474564 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f718e545-3743-4bc6-b586-12c9787ceed3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:09.482104 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f718e545-3743-4bc6-b586-12c9787ceed3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:09.482567 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f718e545-3743-4bc6-b586-12c9787ceed3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:09.483971 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f718e545-3743-4bc6-b586-12c9787ceed3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:09.484449 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f718e545-3743-4bc6-b586-12c9787ceed3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:09.567133 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f718e545-3743-4bc6-b586-12c9787ceed3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.097378 Jan 25 03:52:09.567701 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 811/1555] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:09 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:10.579710 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c3dc77d8-9bec-4c75-95f6-df44f2160819 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:10.580914 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c3dc77d8-9bec-4c75-95f6-df44f2160819 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:10.588383 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3dc77d8-9bec-4c75-95f6-df44f2160819 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:10.588839 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3dc77d8-9bec-4c75-95f6-df44f2160819 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:10.589623 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3dc77d8-9bec-4c75-95f6-df44f2160819 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:10.590066 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c3dc77d8-9bec-4c75-95f6-df44f2160819 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:10.674947 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c3dc77d8-9bec-4c75-95f6-df44f2160819 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.100208 Jan 25 03:52:10.676295 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 745/1556] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:10 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:52:11.687302 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-89ccb247-3c50-4d87-8f56-c3122dfb4b63 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:11.688455 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-89ccb247-3c50-4d87-8f56-c3122dfb4b63 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:11.695319 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89ccb247-3c50-4d87-8f56-c3122dfb4b63 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:11.695776 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89ccb247-3c50-4d87-8f56-c3122dfb4b63 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:11.696592 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89ccb247-3c50-4d87-8f56-c3122dfb4b63 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:11.697037 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-89ccb247-3c50-4d87-8f56-c3122dfb4b63 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:11.779333 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-89ccb247-3c50-4d87-8f56-c3122dfb4b63 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.096653 Jan 25 03:52:11.779964 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 812/1557] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:11 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:12.791952 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-e57cd0f2-b080-4885-814c-f7f8853ff7b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:12.792934 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-e57cd0f2-b080-4885-814c-f7f8853ff7b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:12.800192 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e57cd0f2-b080-4885-814c-f7f8853ff7b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:12.800634 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e57cd0f2-b080-4885-814c-f7f8853ff7b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:12.801395 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e57cd0f2-b080-4885-814c-f7f8853ff7b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:12.801825 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-e57cd0f2-b080-4885-814c-f7f8853ff7b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:12.885745 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-e57cd0f2-b080-4885-814c-f7f8853ff7b9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.097714 Jan 25 03:52:12.886366 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 746/1558] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:12 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:13.897697 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-41f1cb0f-8a34-4b05-a66b-989a99961519 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:13.898686 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-41f1cb0f-8a34-4b05-a66b-989a99961519 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:13.906106 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41f1cb0f-8a34-4b05-a66b-989a99961519 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:13.906603 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41f1cb0f-8a34-4b05-a66b-989a99961519 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:13.907412 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41f1cb0f-8a34-4b05-a66b-989a99961519 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:13.907847 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-41f1cb0f-8a34-4b05-a66b-989a99961519 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:13.989015 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-41f1cb0f-8a34-4b05-a66b-989a99961519 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.095207 Jan 25 03:52:13.989675 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 813/1559] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:13 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:14.186498 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:52:14.186712 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:52:15.001962 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-50d91306-a2b7-4b0d-8a62-b0f8b080f46c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:15.002881 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-50d91306-a2b7-4b0d-8a62-b0f8b080f46c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:15.009785 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50d91306-a2b7-4b0d-8a62-b0f8b080f46c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:15.010240 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50d91306-a2b7-4b0d-8a62-b0f8b080f46c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:15.011016 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50d91306-a2b7-4b0d-8a62-b0f8b080f46c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:15.011510 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50d91306-a2b7-4b0d-8a62-b0f8b080f46c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:15.095118 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-50d91306-a2b7-4b0d-8a62-b0f8b080f46c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.097758 Jan 25 03:52:15.096006 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 747/1560] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:14 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:16.106318 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-120f7de9-9a4f-4e4d-9dab-a06a4b2a604d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:16.107367 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-120f7de9-9a4f-4e4d-9dab-a06a4b2a604d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:16.114297 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-120f7de9-9a4f-4e4d-9dab-a06a4b2a604d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:16.114759 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-120f7de9-9a4f-4e4d-9dab-a06a4b2a604d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:16.115572 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-120f7de9-9a4f-4e4d-9dab-a06a4b2a604d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:16.116017 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-120f7de9-9a4f-4e4d-9dab-a06a4b2a604d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:16.198998 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-120f7de9-9a4f-4e4d-9dab-a06a4b2a604d tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.096613 Jan 25 03:52:16.199645 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 814/1561] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:16 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:17.210234 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-18280a12-1ebb-40fd-909c-9f57ee0bd1d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:17.211389 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-18280a12-1ebb-40fd-909c-9f57ee0bd1d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:17.219253 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18280a12-1ebb-40fd-909c-9f57ee0bd1d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:17.219709 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18280a12-1ebb-40fd-909c-9f57ee0bd1d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:17.220482 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18280a12-1ebb-40fd-909c-9f57ee0bd1d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:17.220921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-18280a12-1ebb-40fd-909c-9f57ee0bd1d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:17.302416 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-18280a12-1ebb-40fd-909c-9f57ee0bd1d5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.096052 Jan 25 03:52:17.303075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 748/1562] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:17 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:18.314350 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-f31004d2-bd6b-4be8-9535-fdd12cbcced8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:18.315357 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-f31004d2-bd6b-4be8-9535-fdd12cbcced8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:18.322109 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f31004d2-bd6b-4be8-9535-fdd12cbcced8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:18.322557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f31004d2-bd6b-4be8-9535-fdd12cbcced8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:18.323354 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f31004d2-bd6b-4be8-9535-fdd12cbcced8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:18.323788 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-f31004d2-bd6b-4be8-9535-fdd12cbcced8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:18.410607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-f31004d2-bd6b-4be8-9535-fdd12cbcced8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.100174 Jan 25 03:52:18.411515 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 815/1563] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:18 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:19.422914 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-866e77d8-0851-44e3-9e94-3faa18844fd3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:19.423932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-866e77d8-0851-44e3-9e94-3faa18844fd3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:19.430794 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-866e77d8-0851-44e3-9e94-3faa18844fd3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:19.431289 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-866e77d8-0851-44e3-9e94-3faa18844fd3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:19.432056 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-866e77d8-0851-44e3-9e94-3faa18844fd3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:19.432487 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-866e77d8-0851-44e3-9e94-3faa18844fd3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:19.519359 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-866e77d8-0851-44e3-9e94-3faa18844fd3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.100931 Jan 25 03:52:19.519931 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 749/1564] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:19 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:20.531447 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a0307d85-1940-4e41-8478-a29101615740 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:20.532433 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a0307d85-1940-4e41-8478-a29101615740 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:20.539215 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0307d85-1940-4e41-8478-a29101615740 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:20.539664 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0307d85-1940-4e41-8478-a29101615740 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:20.540426 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0307d85-1940-4e41-8478-a29101615740 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:20.540859 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a0307d85-1940-4e41-8478-a29101615740 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:20.626774 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a0307d85-1940-4e41-8478-a29101615740 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.099621 Jan 25 03:52:20.627380 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 816/1565] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:20 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:21.644492 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-67c075d8-eac2-49ec-9267-87f4e59a9c70 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:21.645511 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-67c075d8-eac2-49ec-9267-87f4e59a9c70 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:21.652314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67c075d8-eac2-49ec-9267-87f4e59a9c70 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:21.652764 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67c075d8-eac2-49ec-9267-87f4e59a9c70 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:21.653529 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67c075d8-eac2-49ec-9267-87f4e59a9c70 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:21.653961 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-67c075d8-eac2-49ec-9267-87f4e59a9c70 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:21.736069 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-67c075d8-eac2-49ec-9267-87f4e59a9c70 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.095469 Jan 25 03:52:21.736711 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 750/1566] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:21 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 25 03:52:22.747667 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-03dc63cd-0740-4ca2-af87-646042549601 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:22.749045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-03dc63cd-0740-4ca2-af87-646042549601 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:22.756103 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03dc63cd-0740-4ca2-af87-646042549601 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:22.756557 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03dc63cd-0740-4ca2-af87-646042549601 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:22.757333 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03dc63cd-0740-4ca2-af87-646042549601 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:22.757769 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-03dc63cd-0740-4ca2-af87-646042549601 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:22.844630 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-03dc63cd-0740-4ca2-af87-646042549601 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28694 microversion: 2.1 time: 0.100850 Jan 25 03:52:22.845264 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 817/1567] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:22 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:23.856609 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-72d8c8cf-8527-4dce-9df7-145d0136be90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:23.857610 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-72d8c8cf-8527-4dce-9df7-145d0136be90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:23.865027 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-72d8c8cf-8527-4dce-9df7-145d0136be90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:23.865495 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-72d8c8cf-8527-4dce-9df7-145d0136be90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:23.866259 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-72d8c8cf-8527-4dce-9df7-145d0136be90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:23.866699 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-72d8c8cf-8527-4dce-9df7-145d0136be90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:23.959016 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-72d8c8cf-8527-4dce-9df7-145d0136be90 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 28966 microversion: 2.1 time: 0.106324 Jan 25 03:52:23.959720 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 751/1568] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:23 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 28966 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:24.971252 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e4950896-449d-4984-a72a-9f999e30f0cb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:24.972258 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e4950896-449d-4984-a72a-9f999e30f0cb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:24.979199 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4950896-449d-4984-a72a-9f999e30f0cb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:24.979658 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4950896-449d-4984-a72a-9f999e30f0cb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:24.980438 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4950896-449d-4984-a72a-9f999e30f0cb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:24.980881 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e4950896-449d-4984-a72a-9f999e30f0cb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:25.077036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e4950896-449d-4984-a72a-9f999e30f0cb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 31192 microversion: 2.1 time: 0.109216 Jan 25 03:52:25.078216 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 818/1569] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:24 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 31192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:26.089700 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-4d3d2a56-82bc-4970-b986-001f03048cc9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:26.090701 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-4d3d2a56-82bc-4970-b986-001f03048cc9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:26.098202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d3d2a56-82bc-4970-b986-001f03048cc9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:26.098657 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d3d2a56-82bc-4970-b986-001f03048cc9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:26.099480 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d3d2a56-82bc-4970-b986-001f03048cc9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:26.099925 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-4d3d2a56-82bc-4970-b986-001f03048cc9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:26.191263 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-4d3d2a56-82bc-4970-b986-001f03048cc9 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 32876 microversion: 2.1 time: 0.105505 Jan 25 03:52:26.191955 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 752/1570] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:26 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 32876 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:27.204053 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a78ddac2-a6b6-4a6a-b3b0-160c126c5bc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:27.205086 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a78ddac2-a6b6-4a6a-b3b0-160c126c5bc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:27.211993 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a78ddac2-a6b6-4a6a-b3b0-160c126c5bc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:27.212453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a78ddac2-a6b6-4a6a-b3b0-160c126c5bc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:27.213233 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a78ddac2-a6b6-4a6a-b3b0-160c126c5bc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:27.213677 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a78ddac2-a6b6-4a6a-b3b0-160c126c5bc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:27.303851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a78ddac2-a6b6-4a6a-b3b0-160c126c5bc1 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 33890 microversion: 2.1 time: 0.104620 Jan 25 03:52:27.304491 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 819/1571] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:27 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 33890 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:28.316979 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b0dfa1db-68f0-49c0-8272-a16fe28ae62e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:28.317970 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b0dfa1db-68f0-49c0-8272-a16fe28ae62e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:28.324804 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0dfa1db-68f0-49c0-8272-a16fe28ae62e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:28.325256 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0dfa1db-68f0-49c0-8272-a16fe28ae62e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:28.326029 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0dfa1db-68f0-49c0-8272-a16fe28ae62e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:28.326553 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b0dfa1db-68f0-49c0-8272-a16fe28ae62e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:28.423348 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b0dfa1db-68f0-49c0-8272-a16fe28ae62e tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 35249 microversion: 2.1 time: 0.110293 Jan 25 03:52:28.424009 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 753/1572] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:28 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 35249 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:29.435025 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-9943e3dc-6252-4567-8672-277b2a88d43c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:29.436599 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-9943e3dc-6252-4567-8672-277b2a88d43c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:29.443462 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9943e3dc-6252-4567-8672-277b2a88d43c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:29.443926 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9943e3dc-6252-4567-8672-277b2a88d43c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:29.444705 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9943e3dc-6252-4567-8672-277b2a88d43c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:29.445150 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-9943e3dc-6252-4567-8672-277b2a88d43c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:29.537213 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-9943e3dc-6252-4567-8672-277b2a88d43c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 36842 microversion: 2.1 time: 0.106018 Jan 25 03:52:29.537775 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 820/1573] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:29 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 36842 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:30.550573 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-88ccdc1c-cdcb-4225-bf3d-5287876688e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:30.551603 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-88ccdc1c-cdcb-4225-bf3d-5287876688e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:30.558466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-88ccdc1c-cdcb-4225-bf3d-5287876688e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:30.558921 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-88ccdc1c-cdcb-4225-bf3d-5287876688e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:30.559733 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-88ccdc1c-cdcb-4225-bf3d-5287876688e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:30.560216 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-88ccdc1c-cdcb-4225-bf3d-5287876688e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:30.652008 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-88ccdc1c-cdcb-4225-bf3d-5287876688e5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 38229 microversion: 2.1 time: 0.105623 Jan 25 03:52:30.653767 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 754/1574] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:30 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 38229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:31.664032 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-1cf3411e-6e83-4e9b-97a6-d4a73be36beb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:31.665036 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-1cf3411e-6e83-4e9b-97a6-d4a73be36beb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:31.672777 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1cf3411e-6e83-4e9b-97a6-d4a73be36beb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:31.677655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1cf3411e-6e83-4e9b-97a6-d4a73be36beb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:31.677655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1cf3411e-6e83-4e9b-97a6-d4a73be36beb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:31.677655 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-1cf3411e-6e83-4e9b-97a6-d4a73be36beb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:31.759681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-1cf3411e-6e83-4e9b-97a6-d4a73be36beb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 38229 microversion: 2.1 time: 0.099452 Jan 25 03:52:31.760587 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 821/1575] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:31 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 38229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:32.773031 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-b7fc3dea-fd66-4f9e-9c3f-314651239c10 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:32.774032 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-b7fc3dea-fd66-4f9e-9c3f-314651239c10 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:32.781314 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7fc3dea-fd66-4f9e-9c3f-314651239c10 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:32.781768 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7fc3dea-fd66-4f9e-9c3f-314651239c10 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:32.782549 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7fc3dea-fd66-4f9e-9c3f-314651239c10 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:32.782990 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-b7fc3dea-fd66-4f9e-9c3f-314651239c10 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:32.868604 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-b7fc3dea-fd66-4f9e-9c3f-314651239c10 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 38229 microversion: 2.1 time: 0.099592 Jan 25 03:52:32.869244 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 755/1576] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:32 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 38229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:33.880863 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-ed8881cb-d31c-4864-93ee-3c82b65fc401 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:33.881899 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-ed8881cb-d31c-4864-93ee-3c82b65fc401 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:33.889454 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ed8881cb-d31c-4864-93ee-3c82b65fc401 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:33.889913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ed8881cb-d31c-4864-93ee-3c82b65fc401 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:33.890695 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ed8881cb-d31c-4864-93ee-3c82b65fc401 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:33.891180 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-ed8881cb-d31c-4864-93ee-3c82b65fc401 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:33.975905 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-ed8881cb-d31c-4864-93ee-3c82b65fc401 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 38229 microversion: 2.1 time: 0.098964 Jan 25 03:52:33.976897 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 822/1577] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:33 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 38229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:34.988890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-50a2465f-4c4d-455b-9d35-54cbbe27a2dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:34.989890 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-50a2465f-4c4d-455b-9d35-54cbbe27a2dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:34.997075 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50a2465f-4c4d-455b-9d35-54cbbe27a2dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:34.998832 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50a2465f-4c4d-455b-9d35-54cbbe27a2dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:34.999279 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50a2465f-4c4d-455b-9d35-54cbbe27a2dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:34.999777 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-50a2465f-4c4d-455b-9d35-54cbbe27a2dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:35.095867 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-50a2465f-4c4d-455b-9d35-54cbbe27a2dd tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 38242 microversion: 2.1 time: 0.110761 Jan 25 03:52:35.096679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 756/1578] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:34 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 38242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:36.108471 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d7c1f089-a907-4739-aa7f-be290385dcb4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:36.109460 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d7c1f089-a907-4739-aa7f-be290385dcb4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:36.116265 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c1f089-a907-4739-aa7f-be290385dcb4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:36.116715 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c1f089-a907-4739-aa7f-be290385dcb4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:36.117484 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c1f089-a907-4739-aa7f-be290385dcb4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:36.117914 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7c1f089-a907-4739-aa7f-be290385dcb4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:36.217218 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d7c1f089-a907-4739-aa7f-be290385dcb4 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action" status: 200 len: 38360 microversion: 2.1 time: 0.112763 Jan 25 03:52:36.217877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 823/1579] 10.222.0.115 () {60 vars in 1282 bytes} [Tue Jan 25 03:52:36 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/action => generated 38360 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 25 03:52:36.227999 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c0f6550a-9f3f-48f0-b283-fd610638c2ca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:52:36.228584 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c0f6550a-9f3f-48f0-b283-fd610638c2ca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:36.235724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0f6550a-9f3f-48f0-b283-fd610638c2ca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:36.236179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0f6550a-9f3f-48f0-b283-fd610638c2ca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:36.236967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0f6550a-9f3f-48f0-b283-fd610638c2ca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:36.237408 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0f6550a-9f3f-48f0-b283-fd610638c2ca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:36.261140 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c0f6550a-9f3f-48f0-b283-fd610638c2ca tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/ips" status: 200 len: 146 microversion: 2.1 time: 0.037153 Jan 25 03:52:36.261724 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 757/1580] 10.222.0.115 () {58 vars in 1252 bytes} [Tue Jan 25 03:52:36 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:52:38.852211 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-59d6c335-0184-4ac6-98ba-40fc56692714 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3529d5a-b6e0-4555-bbf1-3f4fefedfba8"}} {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:38.853335 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-59d6c335-0184-4ac6-98ba-40fc56692714 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:38.860221 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-59d6c335-0184-4ac6-98ba-40fc56692714 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:38.860670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-59d6c335-0184-4ac6-98ba-40fc56692714 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:38.861435 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-59d6c335-0184-4ac6-98ba-40fc56692714 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:38.861867 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-59d6c335-0184-4ac6-98ba-40fc56692714 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:39.594913 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-59d6c335-0184-4ac6-98ba-40fc56692714 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746637 Jan 25 03:52:39.595554 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 824/1581] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:52:38 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:52:47.062412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-fffc7f55-f2ad-4974-b0b3-fcd43e3dcf7c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:52:47.069346 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-fffc7f55-f2ad-4974-b0b3-fcd43e3dcf7c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:47.069641 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fffc7f55-f2ad-4974-b0b3-fcd43e3dcf7c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:47.070092 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fffc7f55-f2ad-4974-b0b3-fcd43e3dcf7c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:47.070865 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fffc7f55-f2ad-4974-b0b3-fcd43e3dcf7c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:47.071323 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-fffc7f55-f2ad-4974-b0b3-fcd43e3dcf7c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:47.098948 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-fffc7f55-f2ad-4974-b0b3-fcd43e3dcf7c tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040972 Jan 25 03:52:47.099466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 758/1582] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:52:47 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:52:47.111075 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e99f6fd5-0bb8-4081-9323-2e2c618fd03b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:52:47.111672 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e99f6fd5-0bb8-4081-9323-2e2c618fd03b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:47.118315 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e99f6fd5-0bb8-4081-9323-2e2c618fd03b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:47.118810 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e99f6fd5-0bb8-4081-9323-2e2c618fd03b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:47.119631 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e99f6fd5-0bb8-4081-9323-2e2c618fd03b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:47.120072 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e99f6fd5-0bb8-4081-9323-2e2c618fd03b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:47.149742 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e99f6fd5-0bb8-4081-9323-2e2c618fd03b tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/d3529d5a-b6e0-4555-bbf1-3f4fefedfba8" status: 200 len: 194 microversion: 2.1 time: 0.044206 Jan 25 03:52:47.150354 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 825/1583] 10.222.0.115 () {58 vars in 1417 bytes} [Tue Jan 25 03:52:47 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/d3529d5a-b6e0-4555-bbf1-3f4fefedfba8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:52:48.853986 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-27b50d42-5158-46df-9c4a-edac8fc143e6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f49578ba-7ab3-4c32-9f5a-42113aef006c"}} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:52:48.860352 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-27b50d42-5158-46df-9c4a-edac8fc143e6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:48.862171 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27b50d42-5158-46df-9c4a-edac8fc143e6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:48.862615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27b50d42-5158-46df-9c4a-edac8fc143e6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:48.863422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27b50d42-5158-46df-9c4a-edac8fc143e6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:48.863856 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-27b50d42-5158-46df-9c4a-edac8fc143e6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:49.582018 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-27b50d42-5158-46df-9c4a-edac8fc143e6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731596 Jan 25 03:52:49.582707 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 759/1584] 10.222.0.115 () {60 vars in 1327 bytes} [Tue Jan 25 03:52:48 2022] POST /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:52:58.080840 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-a9ac5c3f-96a3-4c8a-bf50-81e5e77259b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:52:58.090466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-a9ac5c3f-96a3-4c8a-bf50-81e5e77259b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:58.090466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a9ac5c3f-96a3-4c8a-bf50-81e5e77259b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:58.090466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a9ac5c3f-96a3-4c8a-bf50-81e5e77259b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:58.090466 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a9ac5c3f-96a3-4c8a-bf50-81e5e77259b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:58.090885 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-a9ac5c3f-96a3-4c8a-bf50-81e5e77259b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:58.119364 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-a9ac5c3f-96a3-4c8a-bf50-81e5e77259b6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042137 Jan 25 03:52:58.119849 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 826/1585] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:52:58 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:52:58.320792 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-25025011-26d9-4dd2-965c-5e9ab7d263bb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:52:58.321370 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-25025011-26d9-4dd2-965c-5e9ab7d263bb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:58.327636 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25025011-26d9-4dd2-965c-5e9ab7d263bb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:58.328090 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25025011-26d9-4dd2-965c-5e9ab7d263bb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:58.328865 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25025011-26d9-4dd2-965c-5e9ab7d263bb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:58.329323 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-25025011-26d9-4dd2-965c-5e9ab7d263bb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:58.357033 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-25025011-26d9-4dd2-965c-5e9ab7d263bb tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/d3529d5a-b6e0-4555-bbf1-3f4fefedfba8" status: 200 len: 194 microversion: 2.1 time: 0.040874 Jan 25 03:52:58.358466 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 760/1586] 10.222.0.115 () {58 vars in 1417 bytes} [Tue Jan 25 03:52:58 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/d3529d5a-b6e0-4555-bbf1-3f4fefedfba8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:52:58.367844 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:52:58.368348 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:52:58.374877 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:58.375304 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:58.376089 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:52:58.376537 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:52:58.451429 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lazy-loading 'services' on Instance uuid 23d73c28-93e8-4330-95de-2a53b381f015 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:52:58.635806 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-87ceda0d-3c09-4589-87e6-ed8b0ec33a66 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/d3529d5a-b6e0-4555-bbf1-3f4fefedfba8" status: 202 len: 0 microversion: 2.1 time: 0.271536 Jan 25 03:52:58.637081 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 827/1587] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:52:58 2022] DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/d3529d5a-b6e0-4555-bbf1-3f4fefedfba8 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:53:00.787137 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-c0bed94d-edc0-4561-b6f2-599814ee6cae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:00.787644 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-c0bed94d-edc0-4561-b6f2-599814ee6cae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:00.793800 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0bed94d-edc0-4561-b6f2-599814ee6cae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:00.794247 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0bed94d-edc0-4561-b6f2-599814ee6cae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:00.795967 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0bed94d-edc0-4561-b6f2-599814ee6cae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:00.796402 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-c0bed94d-edc0-4561-b6f2-599814ee6cae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:00.823829 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-c0bed94d-edc0-4561-b6f2-599814ee6cae tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/f49578ba-7ab3-4c32-9f5a-42113aef006c" status: 200 len: 194 microversion: 2.1 time: 0.040462 Jan 25 03:53:00.824400 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 761/1588] 10.222.0.115 () {58 vars in 1417 bytes} [Tue Jan 25 03:53:00 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/f49578ba-7ab3-4c32-9f5a-42113aef006c => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:53:00.834848 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:00.835463 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:00.841967 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:00.842706 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:00.843522 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:00.843994 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:00.922636 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lazy-loading 'services' on Instance uuid 23d73c28-93e8-4330-95de-2a53b381f015 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:53:01.074827 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-d7f99c8a-c044-47ae-be73-046a1f780243 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/f49578ba-7ab3-4c32-9f5a-42113aef006c" status: 202 len: 0 microversion: 2.1 time: 0.244306 Jan 25 03:53:01.075453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 828/1589] 10.222.0.115 () {58 vars in 1420 bytes} [Tue Jan 25 03:53:00 2022] DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments/f49578ba-7ab3-4c32-9f5a-42113aef006c => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:53:02.223676 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-706eb541-f23e-4b75-8184-3510ca8fba87 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:02.224855 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-706eb541-f23e-4b75-8184-3510ca8fba87 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:02.230932 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-706eb541-f23e-4b75-8184-3510ca8fba87 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.231412 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-706eb541-f23e-4b75-8184-3510ca8fba87 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.232896 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-706eb541-f23e-4b75-8184-3510ca8fba87 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.233624 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-706eb541-f23e-4b75-8184-3510ca8fba87 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.262771 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-706eb541-f23e-4b75-8184-3510ca8fba87 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042842 Jan 25 03:53:02.263392 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 762/1590] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:53:02 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:53:02.364734 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-5bda65ce-f030-46f5-985b-e551e5e762c6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:02.365790 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-5bda65ce-f030-46f5-985b-e551e5e762c6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:02.372376 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bda65ce-f030-46f5-985b-e551e5e762c6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.372835 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bda65ce-f030-46f5-985b-e551e5e762c6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.373612 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bda65ce-f030-46f5-985b-e551e5e762c6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.374045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-5bda65ce-f030-46f5-985b-e551e5e762c6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.402211 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-5bda65ce-f030-46f5-985b-e551e5e762c6 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041566 Jan 25 03:53:02.402770 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 829/1591] 10.222.0.115 () {58 vars in 1306 bytes} [Tue Jan 25 03:53:02 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 25 03:53:02.457138 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:02.457638 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:02.463559 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.464015 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.464795 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.465233 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.490764 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Going to try to terminate instance {{(pid=123363) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 25 03:53:02.773358 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-64f7c729-3dda-4477-8d1e-a2d7cd957d62 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 204 len: 0 microversion: 2.1 time: 0.319588 Jan 25 03:53:02.773973 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 763/1592] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:53:02 2022] DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 25 03:53:02.782512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:02.783147 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:02.788986 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.789434 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.790241 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:02.790671 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:02.922780 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:53:02.930177 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-0781ab5b-26cb-465b-b6a4-fc0270ebab3f tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1677 microversion: 2.1 time: 0.152023 Jan 25 03:53:02.930755 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 830/1593] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:53:02 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:53:03.949784 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:03.953046 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:03.960917 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:03.961665 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:03.962501 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:03.962980 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:04.098311 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.policy [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123363) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:53:04.105578 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-03fccae5-be4b-4e6b-a810-1c79d14d8ae0 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1677 microversion: 2.1 time: 0.161249 Jan 25 03:53:04.106126 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 764/1594] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:53:03 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 25 03:53:05.122307 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:05.123851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:05.130384 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:05.130912 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:05.131724 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:05.132157 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:05.262616 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:53:05.274380 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8d0bbd9d-1d08-4e16-a28b-60a1727c4ab3 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1677 microversion: 2.1 time: 0.155717 Jan 25 03:53:05.289474 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 831/1595] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:53:05 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:53:05.991969 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [req-f6fda886-d4c3-4676-a596-4a08a03b9c33 req-0163e2fa-2beb-4d85-a909-8b3227bcba52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d73c28-93e8-4330-95de-2a53b381f015", "name": "network-vif-deleted", "tag": "c359d790-25d3-4bb1-8056-5d009e88aa16"}]} {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 25 03:53:05.998136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 25 03:53:05.998136 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: warnings.warn(msg) Jan 25 03:53:06.007839 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-f6fda886-d4c3-4676-a596-4a08a03b9c33 req-0163e2fa-2beb-4d85-a909-8b3227bcba52 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:06.008283 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [req-f6fda886-d4c3-4676-a596-4a08a03b9c33 req-0163e2fa-2beb-4d85-a909-8b3227bcba52 service nova] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:06.025122 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.compute.server_external_events [req-f6fda886-d4c3-4676-a596-4a08a03b9c33 req-0163e2fa-2beb-4d85-a909-8b3227bcba52 service nova] Creating event network-vif-deleted:c359d790-25d3-4bb1-8056-5d009e88aa16 for instance 23d73c28-93e8-4330-95de-2a53b381f015 on hv-cinder-81901 Jan 25 03:53:06.039884 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [req-f6fda886-d4c3-4676-a596-4a08a03b9c33 req-0163e2fa-2beb-4d85-a909-8b3227bcba52 service nova] 10.222.0.115 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114384 Jan 25 03:53:06.040975 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 765/1596] 10.222.0.115 () {64 vars in 1322 bytes} [Tue Jan 25 03:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 25 03:53:06.293000 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:06.293607 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:06.300192 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:06.300681 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:06.301417 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:06.301851 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:06.333188 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:06.333640 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:06.334084 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.objects.instance [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lazy-loading 'fault' on Instance uuid 23d73c28-93e8-4330-95de-2a53b381f015 {{(pid=123362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 25 03:53:06.383634 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.policy [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a0f2bac18ad4e9191dc4fabea7c6e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf2a4190655482593e7a860bbf16549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123362) authorize /opt/stack/nova/nova/policy.py:199}} Jan 25 03:53:06.391739 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-30e7fff2-51a5-427f-9720-f60afdf45f85 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 200 len: 1331 microversion: 2.1 time: 0.102149 Jan 25 03:53:06.392488 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 832/1597] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:53:06 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 25 03:53:07.413062 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:07.413766 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:07.420704 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:07.421157 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:07.421933 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:07.422374 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:07.435133 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] HTTP exception thrown: Instance 23d73c28-93e8-4330-95de-2a53b381f015 could not be found. Jan 25 03:53:07.435723 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Returning 404 to user: Instance 23d73c28-93e8-4330-95de-2a53b381f015 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:53:07.436552 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-02c7e371-57b9-4e86-b8a8-ab4def0aab5a tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 404 len: 111 microversion: 2.1 time: 0.027640 Jan 25 03:53:07.437078 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 766/1598] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:53:07 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:53:07.445045 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-8fba12ff-9b13-465f-87b0-52d56348dece tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '.version_select at 0x7f33a83731f0>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:07.563409 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-8fba12ff-9b13-465f-87b0-52d56348dece tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677902801" status: 202 len: 0 microversion: 2.1 time: 0.121789 Jan 25 03:53:07.563955 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 833/1599] 10.222.0.115 () {58 vars in 1222 bytes} [Tue Jan 25 03:53:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677902801 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 25 03:53:10.890945 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:10.891516 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:10.897860 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:10.898315 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:10.899122 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:10.899567 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:10.913577 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] HTTP exception thrown: Instance 23d73c28-93e8-4330-95de-2a53b381f015 could not be found. Jan 25 03:53:10.914164 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Returning 404 to user: Instance 23d73c28-93e8-4330-95de-2a53b381f015 could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:53:10.914980 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-2deb5a38-f664-43d3-a333-c7be343d8bf8 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 404 len: 111 microversion: 2.1 time: 0.028215 Jan 25 03:53:10.915548 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 767/1600] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:53:10 2022] DELETE /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:53:10.924240 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:10.924889 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 23d73c28-93e8-4330-95de-2a53b381f015] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:10.930700 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:10.931195 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:10.931976 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:10.932419 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:10.946082 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] HTTP exception thrown: Instance 23d73c28-93e8-4330-95de-2a53b381f015 could not be found. Jan 25 03:53:10.946670 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Returning 404 to user: Instance 23d73c28-93e8-4330-95de-2a53b381f015 could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:53:10.947512 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e1967882-5540-4a45-8c89-6a9ae468def5 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015" status: 404 len: 111 microversion: 2.1 time: 0.027963 Jan 25 03:53:10.948054 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 834/1601] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:53:10 2022] GET /compute/v2.1/servers/23d73c28-93e8-4330-95de-2a53b381f015 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:53:12.211900 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:12.212455 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.compute.api [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123363) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:12.218679 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:12.219254 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:12.220053 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:12.220500 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG oslo_concurrency.lockutils [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:12.238296 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.wsgi [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] HTTP exception thrown: Instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a could not be found. Jan 25 03:53:12.239294 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: DEBUG nova.api.openstack.wsgi [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Returning 404 to user: Instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a could not be found. {{(pid=123363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:53:12.240428 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO nova.api.openstack.requestlog [None req-65b41239-9f12-4a7c-96d7-14b7ebfcb471 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "DELETE /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 404 len: 111 microversion: 2.1 time: 0.032810 Jan 25 03:53:12.241398 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: [pid: 123363|app: 0|req: 768/1602] 10.222.0.115 () {58 vars in 1243 bytes} [Tue Jan 25 03:53:12 2022] DELETE /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:53:12.251608 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Calling method '>' {{(pid=123362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 25 03:53:12.252254 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.compute.api [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] [instance: 1ec9d94c-01db-458b-a8e9-df0d45bf666a] Fetching instance by UUID {{(pid=123362) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 25 03:53:12.260200 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:12.260669 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:12.261461 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 25 03:53:12.261901 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG oslo_concurrency.lockutils [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Lock "8cb78da0-bb01-419a-a509-9b31671d00b0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 25 03:53:12.276370 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.wsgi [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] HTTP exception thrown: Instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a could not be found. Jan 25 03:53:12.277229 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: DEBUG nova.api.openstack.wsgi [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] Returning 404 to user: Instance 1ec9d94c-01db-458b-a8e9-df0d45bf666a could not be found. {{(pid=123362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 25 03:53:12.278151 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO nova.api.openstack.requestlog [None req-e59f9cfc-7182-46a6-8a1e-3e8220eb7a00 tempest-AttachVolumeTestJSON-1476317388 tempest-AttachVolumeTestJSON-1476317388-project] 10.222.0.115 "GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a" status: 404 len: 111 microversion: 2.1 time: 0.031297 Jan 25 03:53:12.279173 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: [pid: 123362|app: 0|req: 835/1603] 10.222.0.115 () {58 vars in 1240 bytes} [Tue Jan 25 03:53:12 2022] GET /compute/v2.1/servers/1ec9d94c-01db-458b-a8e9-df0d45bf666a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 25 03:53:49.726570 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:53:49.727229 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:53:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:53:55.028615 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:53:55.029202 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:55:34.194521 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:55:34.195161 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:55:41.128737 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:55:41.129394 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:55:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:56:01.245162 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:56:01.245980 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:56:11.327330 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:56:11.327941 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:56:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:57:09.734987 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:57:09.735744 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:57:15.036735 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:57:15.037422 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:57:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:58:54.202729 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:58:54.203473 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:58:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:59:01.136453 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:59:01.137185 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:59:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:59:21.253579 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:59:21.254953 dv-cinder-819011-2-iscsi devstack@n-api.service[123362]: Tue Jan 25 03:59:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 03:59:31.336179 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 03:59:31.336803 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 03:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 04:00:29.744269 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 04:00:29.745024 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 04:00:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 25 04:00:35.044933 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 25 04:00:35.045749 dv-cinder-819011-2-iscsi devstack@n-api.service[123363]: Tue Jan 25 04:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!